2024-12-17 00:23:24,023 [ 216027 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy (runner:42, check_args_and_update_paths) 2024-12-17 00:23:24,023 [ 216027 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration (runner:90, check_args_and_update_paths) 2024-12-17 00:23:24,024 [ 216027 ] INFO : src dir is not set. Will use /home/ubuntu/_work/_temp/test/git-repo-copy/src (runner:97, check_args_and_update_paths) 2024-12-17 00:23:24,024 [ 216027 ] INFO : base_configs_dir: /home/ubuntu/_work/_temp/test/git-repo-copy/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration (runner:99, check_args_and_update_paths) 2024-12-17 00:23:24,024 [ 216027 ] INFO : Unknown image altinityinfra/dotnet-client (runner:357, ) Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_fp1ps5 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/src/Server/grpc_protos:/ClickHouse/src/Server/grpc_protos --volume=/run:/run/host:ro --mount type=bind,source=/home/ubuntu/_work/_temp/test/dockerd_volume_dir,target=/var/lib/docker -e DOCKER_HELPER_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_BASE_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_KERBERIZED_HADOOP_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_KERBEROS_KDC_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_MYSQL_JAVA_CLIENT_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_MYSQL_JS_CLIENT_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_MYSQL_PHP_CLIENT_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_NGINX_DAV_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_storage_s3/test.py::test_multipart[positive]' test_storage_s3/test.py::test_overwrite test_storage_s3/test.py::test_parallel_reading_with_memory_limit test_storage_s3/test.py::test_partition_by test_storage_s3/test.py::test_partition_by_const_column test_storage_s3/test.py::test_partition_by_string_column test_storage_s3/test.py::test_predefined_connection_configuration 'test_storage_s3/test.py::test_put[auth_positive]' 'test_storage_s3/test.py::test_put[auto]' 'test_storage_s3/test.py::test_put[brotli]' 'test_storage_s3/test.py::test_put[deflate]' 'test_storage_s3/test.py::test_put[gzip]' 'test_storage_s3/test.py::test_put[positive]' 'test_storage_s3/test.py::test_put[xz]' 'test_storage_s3/test.py::test_put[zstd]' 'test_storage_s3/test.py::test_put_csv[auth_positive]' 'test_storage_s3/test.py::test_put_csv[negative]' 'test_storage_s3/test.py::test_put_csv[positive]' test_storage_s3/test.py::test_put_get_with_globs test_storage_s3/test.py::test_put_get_with_redirect test_storage_s3/test.py::test_put_with_zero_redirect test_storage_s3/test.py::test_read_subcolumns test_storage_s3/test.py::test_remote_host_filter test_storage_s3/test.py::test_s3_glob_scheherazade test_storage_s3/test.py::test_s3_list_objects_failure test_storage_s3/test.py::test_s3_schema_inference test_storage_s3/test.py::test_schema_inference_cache test_storage_s3/test.py::test_schema_inference_from_globs test_storage_s3/test.py::test_seekable_formats test_storage_s3/test.py::test_seekable_formats_url test_storage_s3/test.py::test_select_columns test_storage_s3/test.py::test_signatures test_storage_s3/test.py::test_skip_empty_files 'test_storage_s3/test.py::test_storage_s3_get_gzip[bin]' 'test_storage_s3/test.py::test_storage_s3_get_gzip[gz]' test_storage_s3/test.py::test_storage_s3_get_unstable 'test_storage_s3/test.py::test_storage_s3_put_gzip[bin]' 'test_storage_s3/test.py::test_storage_s3_put_gzip[gz]' test_storage_s3/test.py::test_storage_s3_put_uncompressed test_storage_s3/test.py::test_truncate_table test_storage_s3/test.py::test_wrong_format_usage test_storage_s3/test.py::test_wrong_s3_syntax test_system_logs_comment/test.py::test_system_logs_comment test_system_start_stop_listen/test.py::test_all_protocols test_system_start_stop_listen/test.py::test_custom_protocols test_system_start_stop_listen/test.py::test_default_protocols test_system_start_stop_listen/test.py::test_except test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_with_interserver_listen_host test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_without_interserver_listen_host test_temporary_data/test.py::test_tmp_data_no_leftovers test_tmp_policy/test.py::test_disk_selection 'test_ttl_move/test.py::test_alter_multiple_ttls[negative]' 'test_ttl_move/test.py::test_alter_multiple_ttls[positive]' 'test_ttl_move/test.py::test_alter_multiple_ttls[replicated_negative]' 'test_ttl_move/test.py::test_alter_multiple_ttls[replicated_positive]' 'test_ttl_move/test.py::test_alter_with_merge_work[mt]' 'test_ttl_move/test.py::test_alter_with_merge_work[mt_work]' 'test_ttl_move/test.py::test_alter_with_merge_work[replicated]' 'test_ttl_move/test.py::test_alter_with_merge_work[replicated_work]' 'test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[mt]' 'test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[replicated_mt]' 'test_ttl_move/test.py::test_disabled_ttl_move_on_insert[disk]' 'test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_disk]' 'test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_volume]' 'test_ttl_move/test.py::test_disabled_ttl_move_on_insert[volume]' 'test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_do_not_work]' 'test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_work_1]' 'test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_do_not_work]' 'test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_work_1]' 'test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_do_not_work]' 'test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_work]' 'test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_do_not_work]' 'test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_work]' 'test_ttl_move/test.py::test_materialize_ttl_in_partition[mt]' 'test_ttl_move/test.py::test_materialize_ttl_in_partition[replicated]' 'test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work0]' 'test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work1]' 'test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_work]' 'test_ttl_move/test.py::test_merges_to_disk_work[replicated_mt_test_merges_to_disk_work]' 'test_ttl_move/test.py::test_merges_with_full_disk_work[mt_test_merges_with_full_disk_work]' 'test_ttl_move/test.py::test_merges_with_full_disk_work[replicated_mt_test_merges_with_full_disk_work]' 'test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_do_not_work]' 'test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_work]' 'test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_do_not_work]' 'test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_work]' 'test_ttl_move/test.py::test_moves_to_disk_eventually_work[mt_test_moves_to_disk_eventually_work]' 'test_ttl_move/test.py::test_moves_to_disk_eventually_work[replicated_mt_test_moves_to_disk_eventually_work]' 'test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_do_not_work]' 'test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_work]' 'test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_do_not_work]' 'test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_work]' 'test_ttl_move/test.py::test_moves_to_volume_work[mt_test_moves_to_volume_work]' 'test_ttl_move/test.py::test_moves_to_volume_work[replicated_mt_test_moves_to_volume_work]' 'test_ttl_move/test.py::test_moves_work_after_storage_policy_change[mt_test_moves_work_after_storage_policy_change]' 'test_ttl_move/test.py::test_moves_work_after_storage_policy_change[replicated_mt_test_moves_work_after_storage_policy_change]' test_ttl_move/test.py::test_replicated_download_ttl_info 'test_ttl_move/test.py::test_rule_with_invalid_destination[case0]' 'test_ttl_move/test.py::test_rule_with_invalid_destination[case1]' 'test_ttl_move/test.py::test_rule_with_invalid_destination[case2]' 'test_ttl_move/test.py::test_rule_with_invalid_destination[case3]' -vvv" altinityinfra/integration-tests-runner:0-b53fc9f68f30219552c427c7d7d451342728b9a4 '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: repeat-0.9.3, random-0.2, timeout-2.2.0, order-1.0.1, xdist-3.5.0 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_storage_s3/test.py::test_multipart[positive] test_system_logs_comment/test.py::test_system_logs_comment test_ttl_move/test.py::test_alter_multiple_ttls[negative] test_temporary_data/test.py::test_tmp_data_no_leftovers test_tmp_policy/test.py::test_disk_selection test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_with_interserver_listen_host test_system_start_stop_listen/test.py::test_all_protocols [gw5] [ 1%] PASSED test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_with_interserver_listen_host test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_without_interserver_listen_host [gw5] [ 2%] PASSED test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_without_interserver_listen_host [gw4] [ 3%] PASSED test_tmp_policy/test.py::test_disk_selection [gw2] [ 4%] PASSED test_system_logs_comment/test.py::test_system_logs_comment [gw6] [ 5%] PASSED test_temporary_data/test.py::test_tmp_data_no_leftovers [gw3] [ 6%] FAILED test_system_start_stop_listen/test.py::test_all_protocols test_system_start_stop_listen/test.py::test_custom_protocols [gw3] [ 7%] FAILED test_system_start_stop_listen/test.py::test_custom_protocols test_system_start_stop_listen/test.py::test_default_protocols [gw0] [ 8%] PASSED test_ttl_move/test.py::test_alter_multiple_ttls[negative] test_ttl_move/test.py::test_alter_multiple_ttls[positive] [gw3] [ 9%] FAILED test_system_start_stop_listen/test.py::test_default_protocols test_system_start_stop_listen/test.py::test_except [gw3] [ 10%] FAILED test_system_start_stop_listen/test.py::test_except [gw0] [ 11%] PASSED test_ttl_move/test.py::test_alter_multiple_ttls[positive] test_ttl_move/test.py::test_alter_multiple_ttls[replicated_negative] [gw1] [ 12%] PASSED test_storage_s3/test.py::test_multipart[positive] test_storage_s3/test.py::test_overwrite [gw1] [ 13%] PASSED test_storage_s3/test.py::test_overwrite test_storage_s3/test.py::test_parallel_reading_with_memory_limit [gw0] [ 14%] PASSED test_ttl_move/test.py::test_alter_multiple_ttls[replicated_negative] test_ttl_move/test.py::test_alter_multiple_ttls[replicated_positive] [gw1] [ 15%] PASSED test_storage_s3/test.py::test_parallel_reading_with_memory_limit test_storage_s3/test.py::test_partition_by [gw1] [ 16%] PASSED test_storage_s3/test.py::test_partition_by test_storage_s3/test.py::test_partition_by_const_column [gw1] [ 17%] PASSED test_storage_s3/test.py::test_partition_by_const_column test_storage_s3/test.py::test_partition_by_string_column [gw1] [ 18%] PASSED test_storage_s3/test.py::test_partition_by_string_column test_storage_s3/test.py::test_predefined_connection_configuration [gw1] [ 19%] PASSED test_storage_s3/test.py::test_predefined_connection_configuration test_storage_s3/test.py::test_put[auth_positive] [gw1] [ 20%] PASSED test_storage_s3/test.py::test_put[auth_positive] test_storage_s3/test.py::test_put[auto] [gw1] [ 21%] PASSED test_storage_s3/test.py::test_put[auto] test_storage_s3/test.py::test_put[brotli] [gw1] [ 22%] PASSED test_storage_s3/test.py::test_put[brotli] test_storage_s3/test.py::test_put[deflate] [gw1] [ 23%] PASSED test_storage_s3/test.py::test_put[deflate] test_storage_s3/test.py::test_put[gzip] [gw1] [ 24%] PASSED test_storage_s3/test.py::test_put[gzip] test_storage_s3/test.py::test_put[positive] [gw1] [ 25%] PASSED test_storage_s3/test.py::test_put[positive] test_storage_s3/test.py::test_put[xz] [gw1] [ 26%] PASSED test_storage_s3/test.py::test_put[xz] test_storage_s3/test.py::test_put[zstd] [gw1] [ 27%] PASSED test_storage_s3/test.py::test_put[zstd] test_storage_s3/test.py::test_put_csv[auth_positive] [gw1] [ 28%] PASSED test_storage_s3/test.py::test_put_csv[auth_positive] test_storage_s3/test.py::test_put_csv[negative] [gw1] [ 29%] PASSED test_storage_s3/test.py::test_put_csv[negative] test_storage_s3/test.py::test_put_csv[positive] [gw1] [ 30%] PASSED test_storage_s3/test.py::test_put_csv[positive] test_storage_s3/test.py::test_put_get_with_globs [gw1] [ 31%] PASSED test_storage_s3/test.py::test_put_get_with_globs test_storage_s3/test.py::test_put_get_with_redirect [gw1] [ 32%] PASSED test_storage_s3/test.py::test_put_get_with_redirect test_storage_s3/test.py::test_put_with_zero_redirect [gw0] [ 33%] PASSED test_ttl_move/test.py::test_alter_multiple_ttls[replicated_positive] test_ttl_move/test.py::test_alter_with_merge_work[mt] [gw0] [ 34%] PASSED test_ttl_move/test.py::test_alter_with_merge_work[mt] test_ttl_move/test.py::test_alter_with_merge_work[mt_work] [gw1] [ 35%] PASSED test_storage_s3/test.py::test_put_with_zero_redirect test_storage_s3/test.py::test_read_subcolumns [gw1] [ 36%] PASSED test_storage_s3/test.py::test_read_subcolumns test_storage_s3/test.py::test_remote_host_filter [gw1] [ 37%] PASSED test_storage_s3/test.py::test_remote_host_filter test_storage_s3/test.py::test_s3_glob_scheherazade [gw0] [ 38%] PASSED test_ttl_move/test.py::test_alter_with_merge_work[mt_work] test_ttl_move/test.py::test_alter_with_merge_work[replicated] [gw1] [ 39%] PASSED test_storage_s3/test.py::test_s3_glob_scheherazade test_storage_s3/test.py::test_s3_list_objects_failure [gw0] [ 40%] PASSED test_ttl_move/test.py::test_alter_with_merge_work[replicated] test_ttl_move/test.py::test_alter_with_merge_work[replicated_work] [gw1] [ 41%] PASSED test_storage_s3/test.py::test_s3_list_objects_failure test_storage_s3/test.py::test_s3_schema_inference [gw1] [ 42%] PASSED test_storage_s3/test.py::test_s3_schema_inference test_storage_s3/test.py::test_schema_inference_cache [gw0] [ 43%] PASSED test_ttl_move/test.py::test_alter_with_merge_work[replicated_work] test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[mt] [gw0] [ 44%] PASSED test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[mt] test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[replicated_mt] [gw0] [ 45%] PASSED test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[replicated_mt] test_ttl_move/test.py::test_disabled_ttl_move_on_insert[disk] [gw0] [ 46%] PASSED test_ttl_move/test.py::test_disabled_ttl_move_on_insert[disk] test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_disk] [gw0] [ 47%] PASSED test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_disk] test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_volume] [gw0] [ 48%] PASSED test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_volume] test_ttl_move/test.py::test_disabled_ttl_move_on_insert[volume] [gw1] [ 49%] PASSED test_storage_s3/test.py::test_schema_inference_cache test_storage_s3/test.py::test_schema_inference_from_globs [gw1] [ 50%] PASSED test_storage_s3/test.py::test_schema_inference_from_globs test_storage_s3/test.py::test_seekable_formats [gw0] [ 51%] PASSED test_ttl_move/test.py::test_disabled_ttl_move_on_insert[volume] test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_do_not_work] [gw0] [ 52%] PASSED test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_do_not_work] test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_work_1] [gw0] [ 53%] PASSED test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_work_1] test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_do_not_work] [gw0] [ 54%] PASSED test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_do_not_work] test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_work_1] [gw0] [ 55%] PASSED test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_work_1] test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_do_not_work] [gw1] [ 56%] PASSED test_storage_s3/test.py::test_seekable_formats test_storage_s3/test.py::test_seekable_formats_url [gw0] [ 57%] PASSED test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_do_not_work] test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_work] [gw0] [ 58%] PASSED test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_work] test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_do_not_work] [gw0] [ 59%] PASSED test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_do_not_work] test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_work] [gw1] [ 60%] PASSED test_storage_s3/test.py::test_seekable_formats_url test_storage_s3/test.py::test_select_columns [gw0] [ 61%] PASSED test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_work] test_ttl_move/test.py::test_materialize_ttl_in_partition[mt] [gw1] [ 62%] PASSED test_storage_s3/test.py::test_select_columns test_storage_s3/test.py::test_signatures [gw1] [ 63%] PASSED test_storage_s3/test.py::test_signatures test_storage_s3/test.py::test_skip_empty_files [gw1] [ 64%] PASSED test_storage_s3/test.py::test_skip_empty_files test_storage_s3/test.py::test_storage_s3_get_gzip[bin] [gw1] [ 65%] PASSED test_storage_s3/test.py::test_storage_s3_get_gzip[bin] test_storage_s3/test.py::test_storage_s3_get_gzip[gz] [gw1] [ 66%] PASSED test_storage_s3/test.py::test_storage_s3_get_gzip[gz] test_storage_s3/test.py::test_storage_s3_get_unstable [gw0] [ 67%] PASSED test_ttl_move/test.py::test_materialize_ttl_in_partition[mt] test_ttl_move/test.py::test_materialize_ttl_in_partition[replicated] [gw1] [ 68%] PASSED test_storage_s3/test.py::test_storage_s3_get_unstable test_storage_s3/test.py::test_storage_s3_put_gzip[bin] [gw1] [ 69%] PASSED test_storage_s3/test.py::test_storage_s3_put_gzip[bin] test_storage_s3/test.py::test_storage_s3_put_gzip[gz] [gw1] [ 70%] PASSED test_storage_s3/test.py::test_storage_s3_put_gzip[gz] test_storage_s3/test.py::test_storage_s3_put_uncompressed [gw1] [ 71%] PASSED test_storage_s3/test.py::test_storage_s3_put_uncompressed test_storage_s3/test.py::test_truncate_table [gw1] [ 72%] PASSED test_storage_s3/test.py::test_truncate_table test_storage_s3/test.py::test_wrong_format_usage [gw1] [ 73%] PASSED test_storage_s3/test.py::test_wrong_format_usage test_storage_s3/test.py::test_wrong_s3_syntax [gw1] [ 74%] PASSED test_storage_s3/test.py::test_wrong_s3_syntax [gw0] [ 75%] PASSED test_ttl_move/test.py::test_materialize_ttl_in_partition[replicated] test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work0] [gw0] [ 76%] PASSED test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work0] test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work1] [gw0] [ 77%] PASSED test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work1] test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_work] [gw0] [ 78%] PASSED test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_work] test_ttl_move/test.py::test_merges_to_disk_work[replicated_mt_test_merges_to_disk_work] [gw0] [ 79%] PASSED test_ttl_move/test.py::test_merges_to_disk_work[replicated_mt_test_merges_to_disk_work] test_ttl_move/test.py::test_merges_with_full_disk_work[mt_test_merges_with_full_disk_work] [gw0] [ 80%] PASSED test_ttl_move/test.py::test_merges_with_full_disk_work[mt_test_merges_with_full_disk_work] test_ttl_move/test.py::test_merges_with_full_disk_work[replicated_mt_test_merges_with_full_disk_work] [gw0] [ 81%] PASSED test_ttl_move/test.py::test_merges_with_full_disk_work[replicated_mt_test_merges_with_full_disk_work] test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_do_not_work] [gw0] [ 82%] PASSED test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_do_not_work] test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_work] [gw0] [ 83%] PASSED test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_work] test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_do_not_work] [gw0] [ 84%] PASSED test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_do_not_work] test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_work] [gw0] [ 85%] PASSED test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_work] test_ttl_move/test.py::test_moves_to_disk_eventually_work[mt_test_moves_to_disk_eventually_work] [gw0] [ 86%] PASSED test_ttl_move/test.py::test_moves_to_disk_eventually_work[mt_test_moves_to_disk_eventually_work] test_ttl_move/test.py::test_moves_to_disk_eventually_work[replicated_mt_test_moves_to_disk_eventually_work] [gw0] [ 87%] PASSED test_ttl_move/test.py::test_moves_to_disk_eventually_work[replicated_mt_test_moves_to_disk_eventually_work] test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_do_not_work] [gw0] [ 88%] PASSED test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_do_not_work] test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_work] [gw0] [ 89%] PASSED test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_work] test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_do_not_work] [gw0] [ 90%] PASSED test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_do_not_work] test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_work] [gw0] [ 91%] PASSED test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_work] test_ttl_move/test.py::test_moves_to_volume_work[mt_test_moves_to_volume_work] [gw0] [ 92%] PASSED test_ttl_move/test.py::test_moves_to_volume_work[mt_test_moves_to_volume_work] test_ttl_move/test.py::test_moves_to_volume_work[replicated_mt_test_moves_to_volume_work] [gw0] [ 93%] PASSED test_ttl_move/test.py::test_moves_to_volume_work[replicated_mt_test_moves_to_volume_work] test_ttl_move/test.py::test_moves_work_after_storage_policy_change[mt_test_moves_work_after_storage_policy_change] [gw0] [ 94%] PASSED test_ttl_move/test.py::test_moves_work_after_storage_policy_change[mt_test_moves_work_after_storage_policy_change] test_ttl_move/test.py::test_moves_work_after_storage_policy_change[replicated_mt_test_moves_work_after_storage_policy_change] [gw0] [ 95%] PASSED test_ttl_move/test.py::test_moves_work_after_storage_policy_change[replicated_mt_test_moves_work_after_storage_policy_change] test_ttl_move/test.py::test_replicated_download_ttl_info [gw0] [ 96%] PASSED test_ttl_move/test.py::test_replicated_download_ttl_info test_ttl_move/test.py::test_rule_with_invalid_destination[case0] [gw0] [ 97%] PASSED test_ttl_move/test.py::test_rule_with_invalid_destination[case0] test_ttl_move/test.py::test_rule_with_invalid_destination[case1] [gw0] [ 98%] PASSED test_ttl_move/test.py::test_rule_with_invalid_destination[case1] test_ttl_move/test.py::test_rule_with_invalid_destination[case2] [gw0] [ 99%] PASSED test_ttl_move/test.py::test_rule_with_invalid_destination[case2] test_ttl_move/test.py::test_rule_with_invalid_destination[case3] [gw0] [100%] PASSED test_ttl_move/test.py::test_rule_with_invalid_destination[case3] =================================== FAILURES =================================== ______________________________ test_all_protocols ______________________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_all_protocols(started_cluster): custom_client = Client(main_node.ip_address, 9001, command=cluster.client_bin_path) assert_everything_works() # STOP LISTEN QUERIES ALL main_node.query("SYSTEM STOP LISTEN QUERIES ALL") assert "Connection refused" in main_node.query_and_get_error(QUERY) assert "Connection refused" in custom_client.query_and_get_error(QUERY) assert http_works() == False assert http_works(8124) == False backup_node.query("SYSTEM START LISTEN ON CLUSTER default QUERIES ALL") # STOP LISTEN QUERIES DEFAULT assert_everything_works() main_node.query("SYSTEM STOP LISTEN QUERIES DEFAULT") assert "Connection refused" in main_node.query_and_get_error(QUERY) custom_client.query(QUERY) assert http_works() == False assert http_works(8124) backup_node.query("SYSTEM START LISTEN ON CLUSTER default QUERIES DEFAULT") # STOP LISTEN QUERIES CUSTOM assert_everything_works() main_node.query("SYSTEM STOP LISTEN QUERIES CUSTOM") main_node.query(QUERY) assert "Connection refused" in custom_client.query_and_get_error(QUERY) assert http_works() assert http_works(8124) == False backup_node.query("SYSTEM START LISTEN ON CLUSTER default QUERIES CUSTOM") # Disable all protocols, check first START LISTEN QUERIES DEFAULT then START LISTEN QUERIES CUSTOM assert_everything_works() main_node.query("SYSTEM STOP LISTEN QUERIES ALL") backup_node.query("SYSTEM START LISTEN ON CLUSTER default QUERIES DEFAULT") main_node.query(QUERY) assert "Connection refused" in custom_client.query_and_get_error(QUERY) assert http_works() assert http_works(8124) == False > main_node.query("SYSTEM STOP LISTEN QUERIES ALL") test_system_start_stop_listen/test.py:166: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ helpers/cluster.py:3424: in query return self.client.query( helpers/client.py:36: in wrap return func(self, *args, **kwargs) helpers/client.py:74: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 32, stderr: Error on processing query: Code: 32. DB::Exception: Attempt to read after eof: while receiving packet from 172.16.5.5:9000. (ATTEMPT_TO_READ_AFTER_EOF), Stack trace (when copying this message, always include the lines below): E E 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c625557 in /clickhouse E 1. DB::Exception::Exception(int, char const (&) [26]) @ 0x0000000007330840 in /clickhouse E 2. DB::throwReadAfterEOF() @ 0x000000000c68ff83 in /clickhouse E 3. DB::Connection::receivePacket() @ 0x0000000013065034 in /clickhouse E 4. DB::ClientBase::receiveAndProcessPacket(std::shared_ptr, bool) @ 0x0000000013037d05 in /clickhouse E 5. DB::ClientBase::processParsedSingleQuery(String const&, String const&, std::shared_ptr, std::optional, bool) @ 0x00000000130358a1 in /clickhouse E 6. DB::ClientBase::executeMultiQuery(String const&) @ 0x00000000130404c9 in /clickhouse E 7. DB::ClientBase::processQueryText(String const&) @ 0x00000000130414f0 in /clickhouse E 8. DB::ClientBase::runNonInteractive() @ 0x0000000013045f6f in /clickhouse E 9. DB::Client::main(std::vector> const&) @ 0x000000000c776294 in /clickhouse E 10. Poco::Util::Application::run() @ 0x0000000015b5f786 in /clickhouse E 11. mainEntryClickHouseClient(int, char**) @ 0x000000000c789668 in /clickhouse E 12. main @ 0x0000000007130eef in /clickhouse E 13. ? @ 0x00007f5611042d90 in ? E 14. ? @ 0x00007f5611042e40 in ? E 15. _start @ 0x000000000635c36e in /clickhouse E (version 23.8.16.43.altinitystable (altinity build)) E (query: SYSTEM STOP LISTEN QUERIES ALL) helpers/client.py:239: QueryRuntimeException ---------------------------- Captured stdout setup ----------------------------- Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml Copy common default production configuration from /clickhouse-config. Files: config.xml, users.xml ---------------------------- Captured stderr setup ----------------------------- WARNING: API is accessible on http://0.0.0.0:2375 without encryption. Access to the remote API is equivalent to root access on the host. Refer to the 'Docker daemon attack surface' section in the documentation for more information: https://docs.docker.com/go/attack-surface/ WARNING: API is accessible on http://0.0.0.0:2375 without encryption. Access to the remote API is equivalent to root access on the host. Refer to the 'Docker daemon attack surface' section in the documentation for more information: https://docs.docker.com/go/attack-surface/ ------------------------------ Captured log setup ------------------------------ 2024-12-17 00:23:27 [ 420 ] DEBUG : Command:['docker ps | wc -l'] (cluster.py:105, run_and_check) 2024-12-17 00:23:27 [ 420 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check) 2024-12-17 00:23:27 [ 420 ] DEBUG : No running containers (conftest.py:60, cleanup_environment) 2024-12-17 00:23:27 [ 420 ] DEBUG : Pruning Docker networks (conftest.py:62, cleanup_environment) 2024-12-17 00:23:27 [ 420 ] DEBUG : Command:['docker network prune --force'] (cluster.py:105, run_and_check) 2024-12-17 00:23:27 [ 420 ] DEBUG : Command:["sysctl net.ipv4.ip_local_port_range='55000 65535'"] (cluster.py:105, run_and_check) 2024-12-17 00:23:27 [ 420 ] DEBUG : Stdout:net.ipv4.ip_local_port_range = 55000 65535 (cluster.py:113, run_and_check) 2024-12-17 00:23:27 [ 420 ] INFO : Running tests in /ClickHouse/tests/integration/test_system_start_stop_listen/test.py (cluster.py:2637, start) 2024-12-17 00:23:27 [ 420 ] DEBUG : Cluster start called. is_up=False (cluster.py:2644, start) 2024-12-17 00:23:27 [ 420 ] DEBUG : !!! Docker info: Client: Docker Engine - Community Version: 27.3.1 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.17.1 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v2.29.7 Path: /usr/libexec/docker/cli-plugins/docker-compose Server: Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 38 Server Version: 23.0.6 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: runc io.containerd.runc.v2 Default Runtime: runc Init Binary: docker-init containerd version: 7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c runc version: v1.1.14-0-g2c9f560 init version: de40ad0 Security Options: seccomp Profile: builtin cgroupns Kernel Version: 5.15.0-122-generic Operating System: Ubuntu 22.04.5 LTS (containerized) OSType: linux Architecture: x86_64 CPUs: 16 Total Memory: 30.6GiB Name: 0f8a495171df ID: f8e1a8b9-2abb-4ed0-897b-8743bbb7ebc1 Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 65.108.242.32:5000 127.0.0.0/8 Registry Mirrors: http://65.108.242.32:5000/ Live Restore Enabled: false Default Address Pools: Base: 172.17.0.0/12, Size: 24 (cluster.py:722, print_all_docker_pieces) 2024-12-17 00:23:27 [ 420 ] DEBUG : Docker networks for project roottestsystemstartstoplisten are NETWORK ID NAME DRIVER SCOPE (cluster.py:733, print_all_docker_pieces) 2024-12-17 00:23:27 [ 420 ] DEBUG : Docker containers for project roottestsystemstartstoplisten are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:741, print_all_docker_pieces) 2024-12-17 00:23:27 [ 420 ] DEBUG : Docker volumes for project roottestsystemstartstoplisten are DRIVER VOLUME NAME (cluster.py:749, print_all_docker_pieces) 2024-12-17 00:23:27 [ 420 ] DEBUG : Cleanup called (cluster.py:754, cleanup) 2024-12-17 00:23:27 [ 420 ] DEBUG : !!! Docker info: Client: Docker Engine - Community Version: 27.3.1 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.17.1 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v2.29.7 Path: /usr/libexec/docker/cli-plugins/docker-compose Server: Containers: 0 Running: 0 Paused: 0 Stopped: 0 Images: 38 Server Version: 23.0.6 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: io.containerd.runc.v2 runc Default Runtime: runc Init Binary: docker-init containerd version: 7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c runc version: v1.1.14-0-g2c9f560 init version: de40ad0 Security Options: seccomp Profile: builtin cgroupns Kernel Version: 5.15.0-122-generic Operating System: Ubuntu 22.04.5 LTS (containerized) OSType: linux Architecture: x86_64 CPUs: 16 Total Memory: 30.6GiB Name: 0f8a495171df ID: f8e1a8b9-2abb-4ed0-897b-8743bbb7ebc1 Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 65.108.242.32:5000 127.0.0.0/8 Registry Mirrors: http://65.108.242.32:5000/ Live Restore Enabled: false Default Address Pools: Base: 172.17.0.0/12, Size: 24 (cluster.py:722, print_all_docker_pieces) 2024-12-17 00:23:27 [ 420 ] DEBUG : Docker networks for project roottestsystemstartstoplisten are NETWORK ID NAME DRIVER SCOPE (cluster.py:733, print_all_docker_pieces) 2024-12-17 00:23:27 [ 420 ] DEBUG : Docker containers for project roottestsystemstartstoplisten are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:741, print_all_docker_pieces) 2024-12-17 00:23:28 [ 420 ] DEBUG : Docker volumes for project roottestsystemstartstoplisten are DRIVER VOLUME NAME (cluster.py:749, print_all_docker_pieces) 2024-12-17 00:23:28 [ 420 ] DEBUG : Command:docker container list --all --filter name='^/roottestsystemstartstoplisten_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:105, run_and_check) 2024-12-17 00:23:28 [ 420 ] DEBUG : Unstopped containers: {} (cluster.py:768, cleanup) 2024-12-17 00:23:28 [ 420 ] DEBUG : No running containers for project: roottestsystemstartstoplisten (cluster.py:782, cleanup) 2024-12-17 00:23:28 [ 420 ] DEBUG : Trying to prune unused networks... (cluster.py:788, cleanup) 2024-12-17 00:23:28 [ 420 ] DEBUG : Trying to prune unused images... (cluster.py:804, cleanup) 2024-12-17 00:23:28 [ 420 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:105, run_and_check) 2024-12-17 00:23:28 [ 420 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:113, run_and_check) 2024-12-17 00:23:28 [ 420 ] DEBUG : Images pruned (cluster.py:807, cleanup) 2024-12-17 00:23:28 [ 420 ] DEBUG : Trying to prune unused volumes... (cluster.py:813, cleanup) 2024-12-17 00:23:28 [ 420 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:105, run_and_check) 2024-12-17 00:23:28 [ 420 ] DEBUG : Stdout:1 (cluster.py:113, run_and_check) 2024-12-17 00:23:28 [ 420 ] DEBUG : Setup directory for instance: main_node (cluster.py:2657, start) 2024-12-17 00:23:28 [ 420 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4309, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Create directory for common tests configuration (cluster.py:4314, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Copy common configuration from helpers (cluster.py:4334, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Generate and write macros file (cluster.py:4353, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_system_start_stop_listen/configs/cluster.xml', '/ClickHouse/tests/integration/test_system_start_stop_listen/configs/protocols.xml', '/ClickHouse/tests/integration/test_system_start_stop_listen/configs/server.crt', '/ClickHouse/tests/integration/test_system_start_stop_listen/configs/server.key'] to /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/main_node/configs/config.d (cluster.py:4383, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/main_node/database (cluster.py:4400, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/main_node/logs (cluster.py:4411, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4487, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Setup directory for instance: backup_node (cluster.py:2657, start) 2024-12-17 00:23:28 [ 420 ] DEBUG : Create directory for configuration generated in this helper (cluster.py:4309, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Create directory for common tests configuration (cluster.py:4314, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Copy common configuration from helpers (cluster.py:4334, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Generate and write macros file (cluster.py:4353, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Copy custom test config files ['/ClickHouse/tests/integration/test_system_start_stop_listen/configs/cluster.xml'] to /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/backup_node/configs/config.d (cluster.py:4383, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Setup database dir /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/backup_node/database (cluster.py:4400, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Setup logs dir /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/backup_node/logs (cluster.py:4411, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Entrypoint cmd: ["clickhouse", "server", "--config-file=/etc/clickhouse-server/config.xml", "--log-file=/var/log/clickhouse-server/clickhouse-server.log", "--errorlog-file=/var/log/clickhouse-server/clickhouse-server.err.log"] (cluster.py:4487, create_dir) 2024-12-17 00:23:28 [ 420 ] DEBUG : Env {'ASAN_OPTIONS': 'use_sigaltstack=0', 'TSAN_OPTIONS': 'use_sigaltstack=0', 'CLICKHOUSE_WATCHDOG_ENABLE': '0', 'CLICKHOUSE_NATS_TLS_SECURE': '0', 'LLVM_PROFILE_FILE': '/var/lib/clickhouse/server_%h_%p_%m.profraw', 'keeper_binary': '/clickhouse', 'keeper_cmd_prefix': 'clickhouse keeper', 'image': 'altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4', 'user': '0', 'keeper_fs': 'bind', 'keeper_logs_dir1': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/log', 'keeper_config_dir1': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/config', 'keeper_db_dir1': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/coordination', 'keeper_logs_dir2': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/log', 'keeper_config_dir2': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/config', 'keeper_db_dir2': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/coordination', 'keeper_logs_dir3': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/log', 'keeper_config_dir3': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/config', 'keeper_db_dir3': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/coordination'} stored in /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/.env (cluster.py:78, _create_env_file) 2024-12-17 00:23:28 [ 420 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2024-12-17 00:23:28 [ 420 ] DEBUG : No config file found (config.py:28, find_config_file) 2024-12-17 00:23:28 [ 420 ] DEBUG : Trying paths: ['/root/.docker/config.json', '/root/.dockercfg'] (config.py:21, find_config_file) 2024-12-17 00:23:28 [ 420 ] DEBUG : No config file found (config.py:28, find_config_file) 2024-12-17 00:23:28 [ 420 ] DEBUG : http://localhost:None "GET /version HTTP/1.1" 200 826 (connectionpool.py:546, _make_request) 2024-12-17 00:23:28 [ 420 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/.env', '--project-name', 'roottestsystemstartstoplisten', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/main_node/docker-compose.yml', '--file', '/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/backup_node/docker-compose.yml', 'pull'] (cluster.py:105, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo3 ... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo2 ... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo1 ... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling backup_node ... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling main_node ... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo3 ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo3 ... digest: sha256:849539f95a578f74cb... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo3 ... status: image is up to date for a... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo3 ... done (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling backup_node ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling backup_node ... digest: sha256:849539f95a578f74cb... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling backup_node ... status: image is up to date for a... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling backup_node ... done (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo2 ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo2 ... digest: sha256:849539f95a578f74cb... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo2 ... status: image is up to date for a... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo2 ... done (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling main_node ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo1 ... pulling from altinityinfra/integr... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling main_node ... digest: sha256:849539f95a578f74cb... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling main_node ... status: image is up to date for a... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling main_node ... done (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo1 ... digest: sha256:849539f95a578f74cb... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo1 ... status: image is up to date for a... (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Stderr:Pulling zoo1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:23:39 [ 420 ] DEBUG : Setup ZooKeeper (cluster.py:2699, start) 2024-12-17 00:23:39 [ 420 ] DEBUG : Creating internal ZooKeeper dirs: ['/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/log', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/config', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/coordination', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/log', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/config', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/coordination', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/log', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/config', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/coordination'] (cluster.py:2700, start) 2024-12-17 00:23:39 [ 420 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/.env', '--project-name', 'roottestsystemstartstoplisten', '--file', '/compose/docker_compose_keeper.yml', '--verbose', 'up', '-d'] (cluster.py:105, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.config.config.find: Using configuration files: /compose/docker_compose_keeper.yml (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.docker_client.get_client: docker-compose version 1.29.2, build unknown (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:docker-py version: (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:CPython version: 3.10.12 (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:OpenSSL version: OpenSSL 3.0.2 15 Mar 2022 (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker base_url: http+docker://localhost (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.docker_client.get_client: Docker version: Platform={'Name': 'Docker Engine - Community'}, Components=[{'Name': 'Engine', 'Version': '23.0.6', 'Details': {'ApiVersion': '1.42', 'Arch': 'amd64', 'BuildTime': '2023-05-05T21:18:13.000000000+00:00', 'Experimental': 'false', 'GitCommit': '9dbdbd4', 'GoVersion': 'go1.19.9', 'KernelVersion': '5.15.0-122-generic', 'MinAPIVersion': '1.12', 'Os': 'linux'}}, {'Name': 'containerd', 'Version': '1.7.22', 'Details': {'GitCommit': '7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c'}}, {'Name': 'runc', 'Version': '1.1.14', 'Details': {'GitCommit': 'v1.1.14-0-g2c9f560'}}, {'Name': 'docker-init', 'Version': '0.19.0', 'Details': {'GitCommit': 'de40ad0'}}], Version=23.0.6, ApiVersion=1.42, MinAPIVersion=1.12, GitCommit=9dbdbd4, GoVersion=go1.19.9, Os=linux, Arch=amd64, KernelVersion=5.15.0-122-generic, BuildTime=2023-05-05T21:18:13.000000000+00:00 (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestsystemstartstoplisten_default') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info <- () (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker info -> {'Architecture': 'x86_64', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'BridgeNfIp6tables': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'BridgeNfIptables': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'CPUSet': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'CPUShares': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'CgroupDriver': 'cgroupfs', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'CgroupVersion': '2', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'ContainerdCommit': {'Expected': '7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'ID': '7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c'}, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Containers': 1, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_network <- ('roottestsystemstartstoplisten_default') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.network.ensure: Creating network "roottestsystemstartstoplisten_default" with the default driver (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network <- (name='roottestsystemstartstoplisten_default', driver=None, options=None, ipam=None, internal=False, enable_ipv6=False, labels={'com.docker.compose.project': 'roottestsystemstartstoplisten', 'com.docker.compose.network': 'default', 'com.docker.compose.version': '1.29.2'}, attachable=True, check_duplicate=True) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_network -> {'Id': '74575b542f9b1482682b15afd10ab4f5cecadfca8390993549bb981661f65175', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Warning': ''} (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=False, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {, , } (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo3', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo3_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo2', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestsystemstartstoplisten', service='zoo3', number=1)} (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers <- (all=True, filters={'label': ['com.docker.compose.project=roottestsystemstartstoplisten', 'com.docker.compose.service=zoo1', 'com.docker.compose.oneoff=False']}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestsystemstartstoplisten', service='zoo3', number=1) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo2_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker containers -> (list with 0 items) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo1_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestsystemstartstoplisten', service='zoo2', number=1)} (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: {ServiceName(project='roottestsystemstartstoplisten', service='zoo1', number=1)} (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestsystemstartstoplisten', service='zoo1', number=1) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Starting producer thread for ServiceName(project='roottestsystemstartstoplisten', service='zoo2', number=1) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 23c388ac11658b1e5f6b7f03cebc92fc23cc5e0cb04fd4bf2e384f3e4a6acbf3 (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestsystemstartstoplisten_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/coordination', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Links': [], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Source': '/clickhouse', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Target': '/usr/bin/clickhouse', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config3.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4', user='0', volumes={}, name='roottestsystemstartstoplisten_zoo3_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestsystemstartstoplisten', 'com.docker.compose.service': 'zoo3', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/compose', 'com.docker.compose.project.config_files': '/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '23c388ac11658b1e5f6b7f03cebc92fc23cc5e0cb04fd4bf2e384f3e4a6acbf3'}, host_config={'NetworkMode': 'roottestsystemstartstoplisten_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper3/coordination', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestsystemstartstoplisten_default': {'Aliases': ['zoo3'], 'IPAMConfig': {}}}}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image <- ('altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: c8ba3d907319c3df26908075e49d1fef21a4f21457c9a732b5cb7e77ef6b0ce8 (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestsystemstartstoplisten_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Links': [], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/log', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Target': '/var/log/clickhouse-keeper', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config1.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4', user='0', volumes={}, name='roottestsystemstartstoplisten_zoo1_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestsystemstartstoplisten', 'com.docker.compose.service': 'zoo1', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/compose', 'com.docker.compose.project.config_files': '/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': 'c8ba3d907319c3df26908075e49d1fef21a4f21457c9a732b5cb7e77ef6b0ce8'}, host_config={'NetworkMode': 'roottestsystemstartstoplisten_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestsystemstartstoplisten_default': {'Aliases': ['zoo1'], 'IPAMConfig': {}}}}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_image -> {'Architecture': 'amd64', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Author': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Comment': 'buildkit.dockerfile.v0', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'ArgsEscaped': True, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': ['/bin/sh', '-c', 'sleep 1'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Entrypoint': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.service.build_container_labels: Added config hash: 0accbac84653fbfbc8596971205f4198ac10d449579016d3201321948b8c6add (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config <- (links=[], port_bindings={}, binds=[], volumes_from=[], privileged=False, network_mode='roottestsystemstartstoplisten_default', devices=None, device_requests=None, dns=None, dns_opt=['attempts:2', 'timeout:1', 'inet6', 'rotate'], dns_search=None, restart_policy={'Name': 'always', 'MaximumRetryCount': 0}, runtime=None, cap_add=['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], cap_drop=None, mem_limit=None, mem_reservation=None, memswap_limit=None, ulimits=None, log_config={'Type': '', 'Config': {}}, extra_hosts=None, read_only=None, pid_mode=None, security_opt=['label:disable'], ipc_mode=None, cgroup_parent=None, cpu_quota=None, shm_size=None, sysctls=None, pids_limit=None, tmpfs=None, oom_kill_disable=None, oom_score_adj=None, mem_swappiness=None, group_add=None, userns_mode=None, init=None, init_path=None, isolation=None, cpu_count=None, cpu_percent=None, nano_cpus=None, volume_driver=None, cpuset_cpus=None, cpu_shares=None, storage_opt=None, blkio_weight=None, blkio_weight_device=None, device_read_bps=None, device_read_iops=None, device_write_bps=None, device_write_iops=None, mounts=[{'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/coordination', 'Type': 'bind', 'ReadOnly': None}], device_cgroup_rules=None, cpu_period=None, cpu_rt_period=None, cpu_rt_runtime=None) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_host_config -> {'Binds': [], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Links': [], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'LogConfig': {'Config': {}, 'Type': ''}, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Mounts': [{'ReadOnly': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/log', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Target': '/var/log/clickhouse-keeper', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Type': 'bind'}, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: {'ReadOnly': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container <- (entrypoint='clickhouse keeper --config=/etc/clickhouse-keeper/keeper_config2.xml --log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log --errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log', image='altinityinfra/integration-test:0-b53fc9f68f30219552c427c7d7d451342728b9a4', user='0', volumes={}, name='roottestsystemstartstoplisten_zoo2_1', detach=True, environment=[], labels={'com.docker.compose.project': 'roottestsystemstartstoplisten', 'com.docker.compose.service': 'zoo2', 'com.docker.compose.oneoff': 'False', 'com.docker.compose.project.working_dir': '/compose', 'com.docker.compose.project.config_files': '/compose/docker_compose_keeper.yml', 'com.docker.compose.project.environment_file': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/.env', 'com.docker.compose.container-number': '1', 'com.docker.compose.version': '1.29.2', 'com.docker.compose.config-hash': '0accbac84653fbfbc8596971205f4198ac10d449579016d3201321948b8c6add'}, host_config={'NetworkMode': 'roottestsystemstartstoplisten_default', 'RestartPolicy': {'Name': 'always', 'MaximumRetryCount': 0}, 'CapAdd': ['SYS_PTRACE', 'NET_ADMIN', 'IPC_LOCK', 'SYS_NICE'], 'DnsOptions': ['attempts:2', 'timeout:1', 'inet6', 'rotate'], 'SecurityOpt': ['label:disable'], 'VolumesFrom': [], 'Binds': [], 'PortBindings': {}, 'Links': [], 'LogConfig': {'Type': '', 'Config': {}}, 'Mounts': [{'Target': '/var/log/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/log', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse-keeper', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/etc/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/config', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper1/coordination', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/usr/bin/clickhouse', 'Source': '/clickhouse', 'Type': 'bind', 'ReadOnly': None}, {'Target': '/var/lib/clickhouse-keeper', 'Source': '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/keeper2/coordination', 'Type': 'bind', 'ReadOnly': None}]}, networking_config={'EndpointsConfig': {'roottestsystemstartstoplisten_default': {'Aliases': ['zoo2'], 'IPAMConfig': {}}}}) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '8338048ec3fadfb7400bc9eaac9f1824e6ff452cc9e093e5e8a02f56afa869ad', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('8338048ec3fadfb7400bc9eaac9f1824e6ff452cc9e093e5e8a02f56afa869ad') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': 'b44137e4a0f02aedec7f46c56febae8450c233e0e44572c451c77873d890b453', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('b44137e4a0f02aedec7f46c56febae8450c233e0e44572c451c77873d890b453') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config1.xml', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker create_container -> {'Id': '655f42d78b4329c5c07c6c89bdb0e3d62409b81626ee8fb1064415287637382b', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Warnings': []} (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container <- ('655f42d78b4329c5c07c6c89bdb0e3d62409b81626ee8fb1064415287637382b') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config3.xml', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('b44137e4a0f02aedec7f46c56febae8450c233e0e44572c451c77873d890b453', 'roottestsystemstartstoplisten_default') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker inspect_container -> {'AppArmorProfile': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Args': ['keeper', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: '--config=/etc/clickhouse-keeper/keeper_config2.xml', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: '--log-file=/var/log/clickhouse-keeper/clickhouse-keeper.log', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: '--errorlog-file=/var/log/clickhouse-keeper/clickhouse-keeper.err.log'], (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Config': {'AttachStderr': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdin': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'AttachStdout': False, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Cmd': None, (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr: 'Domainname': '', (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:... (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('655f42d78b4329c5c07c6c89bdb0e3d62409b81626ee8fb1064415287637382b', 'roottestsystemstartstoplisten_default') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network <- ('8338048ec3fadfb7400bc9eaac9f1824e6ff452cc9e093e5e8a02f56afa869ad', 'roottestsystemstartstoplisten_default') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('b44137e4a0f02aedec7f46c56febae8450c233e0e44572c451c77873d890b453', 'roottestsystemstartstoplisten_default', aliases=['b44137e4a0f0', 'zoo3'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('655f42d78b4329c5c07c6c89bdb0e3d62409b81626ee8fb1064415287637382b', 'roottestsystemstartstoplisten_default', aliases=['655f42d78b43', 'zoo2'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('b44137e4a0f02aedec7f46c56febae8450c233e0e44572c451c77873d890b453') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker disconnect_container_from_network -> None (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network <- ('8338048ec3fadfb7400bc9eaac9f1824e6ff452cc9e093e5e8a02f56afa869ad', 'roottestsystemstartstoplisten_default', aliases=['8338048ec3fa', 'zoo1'], ipv4_address=None, ipv6_address=None, links=[], link_local_ips=None) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker connect_container_to_network -> None (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('8338048ec3fadfb7400bc9eaac9f1824e6ff452cc9e093e5e8a02f56afa869ad') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start <- ('655f42d78b4329c5c07c6c89bdb0e3d62409b81626ee8fb1064415287637382b') (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestsystemstartstoplisten', service='zoo3', number=1) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo3_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestsystemstartstoplisten', service='zoo1', number=1) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo1_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.cli.verbose_proxy.proxy_callable: docker start -> None (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: ServiceName(project='roottestsystemstartstoplisten', service='zoo2', number=1) (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_zoo2_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.parallel_execute_iter: Finished processing: (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Stderr:compose.parallel.feed_queue: Pending: set() (cluster.py:115, run_and_check) 2024-12-17 00:23:41 [ 420 ] DEBUG : Wait ZooKeeper to start (cluster.py:2337, wait_zookeeper_to_start) 2024-12-17 00:23:41 [ 420 ] DEBUG : get_instance_ip instance_name=zoo1 (cluster.py:1971, get_instance_ip) 2024-12-17 00:23:41 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_zoo1_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:41 [ 420 ] DEBUG : get_kazoo_client: zoo1, ip:172.16.5.3, port:2181, use_ssl:False (cluster.py:3120, get_kazoo_client) 2024-12-17 00:23:41 [ 420 ] INFO : Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False (connection.py:650, _connect) 2024-12-17 00:23:41 [ 420 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2024-12-17 00:23:41 [ 420 ] INFO : Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False (connection.py:650, _connect) 2024-12-17 00:23:41 [ 420 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2024-12-17 00:23:41 [ 420 ] INFO : Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False (connection.py:650, _connect) 2024-12-17 00:23:41 [ 420 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2024-12-17 00:23:42 [ 420 ] INFO : Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False (connection.py:650, _connect) 2024-12-17 00:23:42 [ 420 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2024-12-17 00:23:43 [ 420 ] INFO : Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False (connection.py:650, _connect) 2024-12-17 00:23:43 [ 420 ] WARNING : Connection dropped: socket connection error: Connection refused (connection.py:622, _connect_attempt) 2024-12-17 00:23:44 [ 420 ] INFO : Connecting to 172.16.5.3(172.16.5.3):2181, use_ssl: False (connection.py:650, _connect) 2024-12-17 00:23:44 [ 420 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2024-12-17 00:23:44 [ 420 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2024-12-17 00:23:44 [ 420 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2024-12-17 00:23:44 [ 420 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2024-12-17 00:23:44 [ 420 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2024-12-17 00:23:44 [ 420 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2024-12-17 00:23:44 [ 420 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2024-12-17 00:23:44 [ 420 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2024-12-17 00:23:45 [ 420 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2024-12-17 00:23:45 [ 420 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2024-12-17 00:23:45 [ 420 ] DEBUG : get_instance_ip instance_name=zoo2 (cluster.py:1971, get_instance_ip) 2024-12-17 00:23:45 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_zoo2_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:45 [ 420 ] DEBUG : get_kazoo_client: zoo2, ip:172.16.5.4, port:2181, use_ssl:False (cluster.py:3120, get_kazoo_client) 2024-12-17 00:23:45 [ 420 ] INFO : Connecting to 172.16.5.4(172.16.5.4):2181, use_ssl: False (connection.py:650, _connect) 2024-12-17 00:23:45 [ 420 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2024-12-17 00:23:45 [ 420 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2024-12-17 00:23:45 [ 420 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2024-12-17 00:23:45 [ 420 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2024-12-17 00:23:45 [ 420 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2024-12-17 00:23:45 [ 420 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2024-12-17 00:23:45 [ 420 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2024-12-17 00:23:45 [ 420 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2024-12-17 00:23:45 [ 420 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2024-12-17 00:23:45 [ 420 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2024-12-17 00:23:45 [ 420 ] DEBUG : get_instance_ip instance_name=zoo3 (cluster.py:1971, get_instance_ip) 2024-12-17 00:23:45 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_zoo3_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:45 [ 420 ] DEBUG : get_kazoo_client: zoo3, ip:172.16.5.2, port:2181, use_ssl:False (cluster.py:3120, get_kazoo_client) 2024-12-17 00:23:45 [ 420 ] INFO : Connecting to 172.16.5.2(172.16.5.2):2181, use_ssl: False (connection.py:650, _connect) 2024-12-17 00:23:45 [ 420 ] DEBUG : Sending request(xid=None): Connect(protocol_version=0, last_zxid_seen=0, time_out=10000, session_id=0, passwd=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00', read_only=None) (connection.py:312, _submit) 2024-12-17 00:23:45 [ 420 ] INFO : Zookeeper connection established, state: CONNECTED (client.py:532, _session_callback) 2024-12-17 00:23:45 [ 420 ] DEBUG : Sending request(xid=1): GetChildren(path='/', watcher=None) (connection.py:312, _submit) 2024-12-17 00:23:45 [ 420 ] DEBUG : Received response(xid=1): ['keeper'] (connection.py:410, _read_response) 2024-12-17 00:23:45 [ 420 ] DEBUG : Sending request(xid=2): Close() (connection.py:312, _submit) 2024-12-17 00:23:45 [ 420 ] WARNING : Connection dropped: socket connection broken (connection.py:622, _connect_attempt) 2024-12-17 00:23:45 [ 420 ] WARNING : Transition to CONNECTING (connection.py:626, _connect_attempt) 2024-12-17 00:23:45 [ 420 ] INFO : Zookeeper connection lost (client.py:543, _session_callback) 2024-12-17 00:23:45 [ 420 ] WARNING : Failed connecting to Zookeeper within the connection retry policy. (connection.py:515, zk_loop) 2024-12-17 00:23:45 [ 420 ] INFO : Zookeeper session closed, state: CLOSED (client.py:537, _session_callback) 2024-12-17 00:23:45 [ 420 ] DEBUG : All instances of ZooKeeper started (cluster.py:2345, wait_zookeeper_to_start) 2024-12-17 00:23:45 [ 420 ] DEBUG : ('Trying to create ClickHouse instance by command %s', 'docker-compose --env-file /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/.env --project-name roottestsystemstartstoplisten --file /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/main_node/docker-compose.yml --file /compose/docker_compose_keeper.yml --file /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/backup_node/docker-compose.yml up -d --no-recreate') (cluster.py:2980, start) 2024-12-17 00:23:45 [ 420 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/.env', '--project-name', 'roottestsystemstartstoplisten', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/main_node/docker-compose.yml', '--file', '/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/backup_node/docker-compose.yml', 'up', '-d', '--no-recreate'] (cluster.py:105, run_and_check) 2024-12-17 00:23:46 [ 420 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_main_node_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:23:46 [ 420 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_backup_node_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:23:46 [ 420 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_main_node_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:23:46 [ 420 ] DEBUG : Stderr:Creating roottestsystemstartstoplisten_backup_node_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:23:46 [ 420 ] DEBUG : ClickHouse instance created (cluster.py:2988, start) 2024-12-17 00:23:46 [ 420 ] DEBUG : get_instance_ip instance_name=main_node (cluster.py:1971, get_instance_ip) 2024-12-17 00:23:46 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_main_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:46 [ 420 ] DEBUG : Waiting for ClickHouse start in main_node, ip: 172.16.5.5... (cluster.py:2995, start) 2024-12-17 00:23:46 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_main_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:46 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/51f411d120d8af506d54ddcae283150a28aa62f2d46d6d8fe55ec8f5d0d730d5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:46 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/51f411d120d8af506d54ddcae283150a28aa62f2d46d6d8fe55ec8f5d0d730d5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:46 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/51f411d120d8af506d54ddcae283150a28aa62f2d46d6d8fe55ec8f5d0d730d5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:46 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/51f411d120d8af506d54ddcae283150a28aa62f2d46d6d8fe55ec8f5d0d730d5/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:46 [ 420 ] DEBUG : ClickHouse main_node started (cluster.py:2999, start) 2024-12-17 00:23:46 [ 420 ] DEBUG : get_instance_ip instance_name=backup_node (cluster.py:1971, get_instance_ip) 2024-12-17 00:23:46 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_backup_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:46 [ 420 ] DEBUG : Waiting for ClickHouse start in backup_node, ip: 172.16.5.6... (cluster.py:2995, start) 2024-12-17 00:23:46 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/roottestsystemstartstoplisten_backup_node_1/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:46 [ 420 ] DEBUG : http://localhost:None "GET /v1.42/containers/a96689cce49b8612ad0dbfbffd3f856a105e774b8b12d7238d0a704d9f63bf1d/json HTTP/1.1" 200 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:46 [ 420 ] DEBUG : ClickHouse backup_node started (cluster.py:2999, start) ------------------------------ Captured log call ------------------------------- 2024-12-17 00:23:46 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2024-12-17 00:23:46 [ 420 ] DEBUG : Executing query SELECT * FROM mysql('127.0.0.1:9004', 'system', 'one', 'default', '', SETTINGS connect_timeout = 100, connection_wait_timeout = 100) on main_node (cluster.py:3423, query) 2024-12-17 00:23:47 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8123 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:47 [ 420 ] DEBUG : http://172.16.5.5:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:47 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8124 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:47 [ 420 ] DEBUG : http://172.16.5.5:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:47 [ 420 ] DEBUG : Executing query SYSTEM STOP LISTEN QUERIES ALL on main_node (cluster.py:3423, query) 2024-12-17 00:23:48 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3495, query_and_get_error) 2024-12-17 00:23:48 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8123 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:48 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8124 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:48 [ 420 ] DEBUG : Executing query SYSTEM START LISTEN ON CLUSTER default QUERIES ALL on backup_node (cluster.py:3423, query) 2024-12-17 00:23:48 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2024-12-17 00:23:48 [ 420 ] DEBUG : Executing query SELECT * FROM mysql('127.0.0.1:9004', 'system', 'one', 'default', '', SETTINGS connect_timeout = 100, connection_wait_timeout = 100) on main_node (cluster.py:3423, query) 2024-12-17 00:23:48 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8123 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:48 [ 420 ] DEBUG : http://172.16.5.5:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:48 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8124 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:48 [ 420 ] DEBUG : http://172.16.5.5:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:48 [ 420 ] DEBUG : Executing query SYSTEM STOP LISTEN QUERIES DEFAULT on main_node (cluster.py:3423, query) 2024-12-17 00:23:49 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3495, query_and_get_error) 2024-12-17 00:23:49 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8123 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:49 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8124 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:49 [ 420 ] DEBUG : http://172.16.5.5:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:49 [ 420 ] DEBUG : Executing query SYSTEM START LISTEN ON CLUSTER default QUERIES DEFAULT on backup_node (cluster.py:3423, query) 2024-12-17 00:23:49 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2024-12-17 00:23:49 [ 420 ] DEBUG : Executing query SELECT * FROM mysql('127.0.0.1:9004', 'system', 'one', 'default', '', SETTINGS connect_timeout = 100, connection_wait_timeout = 100) on main_node (cluster.py:3423, query) 2024-12-17 00:23:49 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8123 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:49 [ 420 ] DEBUG : http://172.16.5.5:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:49 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8124 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:49 [ 420 ] DEBUG : http://172.16.5.5:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:49 [ 420 ] DEBUG : Executing query SYSTEM STOP LISTEN QUERIES CUSTOM on main_node (cluster.py:3423, query) 2024-12-17 00:23:49 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2024-12-17 00:23:50 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8123 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:50 [ 420 ] DEBUG : http://172.16.5.5:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:50 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8124 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:50 [ 420 ] DEBUG : Executing query SYSTEM START LISTEN ON CLUSTER default QUERIES CUSTOM on backup_node (cluster.py:3423, query) 2024-12-17 00:23:50 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2024-12-17 00:23:50 [ 420 ] DEBUG : Executing query SELECT * FROM mysql('127.0.0.1:9004', 'system', 'one', 'default', '', SETTINGS connect_timeout = 100, connection_wait_timeout = 100) on main_node (cluster.py:3423, query) 2024-12-17 00:23:50 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8123 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:50 [ 420 ] DEBUG : http://172.16.5.5:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:50 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8124 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:50 [ 420 ] DEBUG : http://172.16.5.5:8124 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:50 [ 420 ] DEBUG : Executing query SYSTEM STOP LISTEN QUERIES ALL on main_node (cluster.py:3423, query) 2024-12-17 00:23:51 [ 420 ] DEBUG : Executing query SYSTEM START LISTEN ON CLUSTER default QUERIES DEFAULT on backup_node (cluster.py:3423, query) 2024-12-17 00:23:51 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) 2024-12-17 00:23:51 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8123 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:51 [ 420 ] DEBUG : http://172.16.5.5:8123 "POST /ping HTTP/1.1" 400 None (connectionpool.py:546, _make_request) 2024-12-17 00:23:51 [ 420 ] DEBUG : Starting new HTTP connection (1): 172.16.5.5:8124 (connectionpool.py:244, _new_conn) 2024-12-17 00:23:51 [ 420 ] DEBUG : Executing query SYSTEM STOP LISTEN QUERIES ALL on main_node (cluster.py:3423, query) ____________________________ test_custom_protocols _____________________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_custom_protocols(started_cluster): # TCP custom_client = Client(main_node.ip_address, 9001, command=cluster.client_bin_path) > assert_everything_works() test_system_start_stop_listen/test.py:110: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_system_start_stop_listen/test.py:67: in assert_everything_works main_node.query(QUERY) helpers/cluster.py:3424: in query return self.client.query( helpers/client.py:36: in wrap return func(self, *args, **kwargs) helpers/client.py:74: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 209, stderr: Code: 209. DB::NetException: Timeout: connect timed out: 172.16.5.5:9000 (172.16.5.5:9000, connection timeout 10000 ms). (SOCKET_TIMEOUT), Stack trace (when copying this message, always include the lines below): E E 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c625557 in /clickhouse E 1. DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String const&, long&&) @ 0x000000001305b679 in /clickhouse E 2. DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001305b2ca in /clickhouse E 3. DB::Connection::getServerVersion(DB::ConnectionTimeouts const&, String&, unsigned long&, unsigned long&, unsigned long&, unsigned long&) @ 0x000000001305c1f0 in /clickhouse E 4. DB::Client::connect() @ 0x000000000c777725 in /clickhouse E 5. DB::Client::main(std::vector> const&) @ 0x000000000c775807 in /clickhouse E 6. Poco::Util::Application::run() @ 0x0000000015b5f786 in /clickhouse E 7. mainEntryClickHouseClient(int, char**) @ 0x000000000c789668 in /clickhouse E 8. main @ 0x0000000007130eef in /clickhouse E 9. ? @ 0x00007fdaa1173d90 in ? E 10. ? @ 0x00007fdaa1173e40 in ? E 11. _start @ 0x000000000635c36e in /clickhouse helpers/client.py:239: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2024-12-17 00:23:52 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) ____________________________ test_default_protocols ____________________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_default_protocols(started_cluster): # TCP > assert_everything_works() test_system_start_stop_listen/test.py:81: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_system_start_stop_listen/test.py:67: in assert_everything_works main_node.query(QUERY) helpers/cluster.py:3424: in query return self.client.query( helpers/client.py:36: in wrap return func(self, *args, **kwargs) helpers/client.py:74: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 209, stderr: Code: 209. DB::NetException: Timeout: connect timed out: 172.16.5.5:9000 (172.16.5.5:9000, connection timeout 10000 ms). (SOCKET_TIMEOUT), Stack trace (when copying this message, always include the lines below): E E 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c625557 in /clickhouse E 1. DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String const&, long&&) @ 0x000000001305b679 in /clickhouse E 2. DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001305b2ca in /clickhouse E 3. DB::Connection::getServerVersion(DB::ConnectionTimeouts const&, String&, unsigned long&, unsigned long&, unsigned long&, unsigned long&) @ 0x000000001305c1f0 in /clickhouse E 4. DB::Client::connect() @ 0x000000000c777725 in /clickhouse E 5. DB::Client::main(std::vector> const&) @ 0x000000000c775807 in /clickhouse E 6. Poco::Util::Application::run() @ 0x0000000015b5f786 in /clickhouse E 7. mainEntryClickHouseClient(int, char**) @ 0x000000000c789668 in /clickhouse E 8. main @ 0x0000000007130eef in /clickhouse E 9. ? @ 0x00007fbe77bbcd90 in ? E 10. ? @ 0x00007fbe77bbce40 in ? E 11. _start @ 0x000000000635c36e in /clickhouse helpers/client.py:239: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2024-12-17 00:24:02 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) _________________________________ test_except __________________________________ [gw3] linux -- Python 3.10.12 /usr/bin/python3 started_cluster = def test_except(started_cluster): custom_client = Client(main_node.ip_address, 9001, command=cluster.client_bin_path) > assert_everything_works() test_system_start_stop_listen/test.py:180: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ test_system_start_stop_listen/test.py:67: in assert_everything_works main_node.query(QUERY) helpers/cluster.py:3424: in query return self.client.query( helpers/client.py:36: in wrap return func(self, *args, **kwargs) helpers/client.py:74: in query ).get_answer() _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = def get_answer(self): self.process.wait(timeout=DEFAULT_QUERY_TIMEOUT) self.stdout_file.seek(0) self.stderr_file.seek(0) stdout = self.stdout_file.read().decode("utf-8", errors="replace") stderr = self.stderr_file.read().decode("utf-8", errors="replace") if ( self.timer is not None and not self.process_finished_before_timeout and not self.ignore_error ): logging.debug(f"Timed out. Last stdout:{stdout}, stderr:{stderr}") raise QueryTimeoutExceedException("Client timed out!") if ( self.process.returncode != 0 or self.remove_trash_from_stderr(stderr) ) and not self.ignore_error: > raise QueryRuntimeException( "Client failed! Return code: {}, stderr: {}".format( self.process.returncode, stderr ), self.process.returncode, stderr, ) E helpers.client.QueryRuntimeException: Client failed! Return code: 209, stderr: Code: 209. DB::NetException: Timeout: connect timed out: 172.16.5.5:9000 (172.16.5.5:9000, connection timeout 10000 ms). (SOCKET_TIMEOUT), Stack trace (when copying this message, always include the lines below): E E 0. DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000000c625557 in /clickhouse E 1. DB::NetException::NetException(int, FormatStringHelperImpl::type, std::type_identity::type, std::type_identity::type>, String&&, String const&, long&&) @ 0x000000001305b679 in /clickhouse E 2. DB::Connection::connect(DB::ConnectionTimeouts const&) @ 0x000000001305b2ca in /clickhouse E 3. DB::Connection::getServerVersion(DB::ConnectionTimeouts const&, String&, unsigned long&, unsigned long&, unsigned long&, unsigned long&) @ 0x000000001305c1f0 in /clickhouse E 4. DB::Client::connect() @ 0x000000000c777725 in /clickhouse E 5. DB::Client::main(std::vector> const&) @ 0x000000000c775807 in /clickhouse E 6. Poco::Util::Application::run() @ 0x0000000015b5f786 in /clickhouse E 7. mainEntryClickHouseClient(int, char**) @ 0x000000000c789668 in /clickhouse E 8. main @ 0x0000000007130eef in /clickhouse E 9. ? @ 0x00007f8665be9d90 in ? E 10. ? @ 0x00007f8665be9e40 in ? E 11. _start @ 0x000000000635c36e in /clickhouse helpers/client.py:239: QueryRuntimeException ------------------------------ Captured log call ------------------------------- 2024-12-17 00:24:12 [ 420 ] DEBUG : Executing query SELECT 1 on main_node (cluster.py:3423, query) --------------------------- Captured stderr teardown --------------------------- WARNING: API is accessible on http://0.0.0.0:2375 without encryption. Access to the remote API is equivalent to root access on the host. Refer to the 'Docker daemon attack surface' section in the documentation for more information: https://docs.docker.com/go/attack-surface/ ---------------------------- Captured log teardown ----------------------------- 2024-12-17 00:24:23 [ 420 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/.env', '--project-name', 'roottestsystemstartstoplisten', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/main_node/docker-compose.yml', '--file', '/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/backup_node/docker-compose.yml', 'stop', '--timeout', '20'] (cluster.py:105, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_backup_node_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo2_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo1_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo3_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_backup_node_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo1_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo2_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Stderr:Stopping roottestsystemstartstoplisten_zoo3_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/main_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/main_node/logs/stderr.log* || true'] (cluster.py:105, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Command:['bash', '-c', '[ -f /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/backup_node/logs/stderr.log ] && zgrep -aH "==================" /ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/backup_node/logs/stderr.log* || true'] (cluster.py:105, run_and_check) 2024-12-17 00:24:26 [ 420 ] DEBUG : Command:['docker-compose', '--env-file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/.env', '--project-name', 'roottestsystemstartstoplisten', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/main_node/docker-compose.yml', '--file', '/compose/docker_compose_keeper.yml', '--file', '/ClickHouse/tests/integration/test_system_start_stop_listen/_instances_0/backup_node/docker-compose.yml', 'down', '--volumes'] (cluster.py:105, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_backup_node_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_main_node_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo2_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo1_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo3_1 ... (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo2_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo3_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_backup_node_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_zoo1_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing roottestsystemstartstoplisten_main_node_1 ... done (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stderr:Removing network roottestsystemstartstoplisten_default (cluster.py:115, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Cleanup called (cluster.py:754, cleanup) 2024-12-17 00:24:27 [ 420 ] DEBUG : !!! Docker info: Client: Docker Engine - Community Version: 27.3.1 Context: default Debug Mode: false Plugins: buildx: Docker Buildx (Docker Inc.) Version: v0.17.1 Path: /usr/libexec/docker/cli-plugins/docker-buildx compose: Docker Compose (Docker Inc.) Version: v2.29.7 Path: /usr/libexec/docker/cli-plugins/docker-compose Server: Containers: 15 Running: 15 Paused: 0 Stopped: 0 Images: 38 Server Version: 23.0.6 Storage Driver: overlay2 Backing Filesystem: extfs Supports d_type: true Using metacopy: false Native Overlay Diff: true userxattr: false Logging Driver: json-file Cgroup Driver: cgroupfs Cgroup Version: 2 Plugins: Volume: local Network: bridge host ipvlan macvlan null overlay Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog Swarm: inactive Runtimes: runc io.containerd.runc.v2 Default Runtime: runc Init Binary: docker-init containerd version: 7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c runc version: v1.1.14-0-g2c9f560 init version: de40ad0 Security Options: seccomp Profile: builtin cgroupns Kernel Version: 5.15.0-122-generic Operating System: Ubuntu 22.04.5 LTS (containerized) OSType: linux Architecture: x86_64 CPUs: 16 Total Memory: 30.6GiB Name: 0f8a495171df ID: f8e1a8b9-2abb-4ed0-897b-8743bbb7ebc1 Docker Root Dir: /var/lib/docker Debug Mode: false Experimental: false Insecure Registries: 65.108.242.32:5000 127.0.0.0/8 Registry Mirrors: http://65.108.242.32:5000/ Live Restore Enabled: false Default Address Pools: Base: 172.17.0.0/12, Size: 24 (cluster.py:722, print_all_docker_pieces) 2024-12-17 00:24:27 [ 420 ] DEBUG : Docker networks for project roottestsystemstartstoplisten are NETWORK ID NAME DRIVER SCOPE (cluster.py:733, print_all_docker_pieces) 2024-12-17 00:24:27 [ 420 ] DEBUG : Docker containers for project roottestsystemstartstoplisten are CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES (cluster.py:741, print_all_docker_pieces) 2024-12-17 00:24:27 [ 420 ] DEBUG : Docker volumes for project roottestsystemstartstoplisten are DRIVER VOLUME NAME (cluster.py:749, print_all_docker_pieces) 2024-12-17 00:24:27 [ 420 ] DEBUG : Command:docker container list --all --filter name='^/roottestsystemstartstoplisten_.*_1$' --format '{{.ID}}:{{.Names}}' (cluster.py:105, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Unstopped containers: {} (cluster.py:768, cleanup) 2024-12-17 00:24:27 [ 420 ] DEBUG : No running containers for project: roottestsystemstartstoplisten (cluster.py:782, cleanup) 2024-12-17 00:24:27 [ 420 ] DEBUG : Trying to prune unused networks... (cluster.py:788, cleanup) 2024-12-17 00:24:27 [ 420 ] DEBUG : Trying to prune unused images... (cluster.py:804, cleanup) 2024-12-17 00:24:27 [ 420 ] DEBUG : Command:['docker', 'image', 'prune', '-f'] (cluster.py:105, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stdout:Total reclaimed space: 0B (cluster.py:113, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Images pruned (cluster.py:807, cleanup) 2024-12-17 00:24:27 [ 420 ] DEBUG : Trying to prune unused volumes... (cluster.py:813, cleanup) 2024-12-17 00:24:27 [ 420 ] DEBUG : Command:['docker volume ls | wc -l'] (cluster.py:105, run_and_check) 2024-12-17 00:24:27 [ 420 ] DEBUG : Stdout:3 (cluster.py:113, run_and_check) ============================== slowest durations =============================== 72.30s setup test_storage_s3/test.py::test_multipart[positive] 32.35s call test_storage_s3/test.py::test_schema_inference_cache 26.62s call test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work0] 26.61s call test_ttl_move/test.py::test_merges_to_disk_work[replicated_mt_test_merges_to_disk_work] 26.61s call test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work1] 26.48s call test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_work] 26.33s call test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_work] 26.29s call test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_do_not_work] 26.27s call test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_do_not_work] 26.22s call test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_work] 25.71s call test_storage_s3/test.py::test_put_with_zero_redirect 22.70s teardown test_storage_s3/test.py::test_wrong_s3_syntax 22.34s call test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_work] 22.28s call test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_do_not_work] 22.25s call test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_do_not_work] 22.24s call test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_work] 19.83s call test_ttl_move/test.py::test_alter_multiple_ttls[positive] 19.47s call test_ttl_move/test.py::test_alter_multiple_ttls[replicated_positive] 19.39s setup test_ttl_move/test.py::test_alter_multiple_ttls[negative] 19.03s setup test_system_start_stop_listen/test.py::test_all_protocols 19.01s call test_ttl_move/test.py::test_alter_multiple_ttls[negative] 18.91s call test_ttl_move/test.py::test_alter_multiple_ttls[replicated_negative] 13.84s setup test_temporary_data/test.py::test_tmp_data_no_leftovers 13.73s call test_ttl_move/test.py::test_moves_work_after_storage_policy_change[replicated_mt_test_moves_work_after_storage_policy_change] 13.58s setup test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_with_interserver_listen_host 12.96s setup test_system_logs_comment/test.py::test_system_logs_comment 12.72s setup test_tmp_policy/test.py::test_disk_selection 12.30s call test_ttl_move/test.py::test_moves_work_after_storage_policy_change[mt_test_moves_work_after_storage_policy_change] 12.02s call test_storage_s3/test.py::test_s3_list_objects_failure 11.91s call test_ttl_move/test.py::test_merges_with_full_disk_work[replicated_mt_test_merges_with_full_disk_work] 11.72s call test_ttl_move/test.py::test_merges_with_full_disk_work[mt_test_merges_with_full_disk_work] 11.17s call test_ttl_move/test.py::test_alter_with_merge_work[replicated_work] 11.07s call test_ttl_move/test.py::test_alter_with_merge_work[replicated] 11.04s call test_ttl_move/test.py::test_moves_to_volume_work[mt_test_moves_to_volume_work] 10.89s call test_ttl_move/test.py::test_alter_with_merge_work[mt_work] 10.82s call test_ttl_move/test.py::test_alter_with_merge_work[mt] 10.61s call test_ttl_move/test.py::test_moves_to_volume_work[replicated_mt_test_moves_to_volume_work] 10.10s call test_system_start_stop_listen/test.py::test_except 10.09s call test_system_start_stop_listen/test.py::test_default_protocols 10.09s call test_system_start_stop_listen/test.py::test_custom_protocols 7.60s call test_temporary_data/test.py::test_tmp_data_no_leftovers 7.02s call test_ttl_move/test.py::test_materialize_ttl_in_partition[replicated] 6.79s call test_ttl_move/test.py::test_materialize_ttl_in_partition[mt] 6.77s call test_storage_s3/test.py::test_put_get_with_globs 5.85s call test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[replicated_mt] 5.73s call test_storage_s3/test.py::test_storage_s3_get_unstable 5.67s call test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[mt] 5.48s call test_system_start_stop_listen/test.py::test_all_protocols 5.30s call test_storage_s3/test.py::test_parallel_reading_with_memory_limit 4.75s teardown test_ttl_move/test.py::test_rule_with_invalid_destination[case3] 4.32s teardown test_system_start_stop_listen/test.py::test_except 4.01s call test_storage_s3/test.py::test_s3_glob_scheherazade 3.97s call test_system_logs_comment/test.py::test_system_logs_comment 3.66s call test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_volume] 3.58s call test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_disk] 3.56s call test_ttl_move/test.py::test_disabled_ttl_move_on_insert[disk] 3.54s teardown test_tmp_policy/test.py::test_disk_selection 3.54s call test_ttl_move/test.py::test_disabled_ttl_move_on_insert[volume] 3.52s teardown test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_without_interserver_listen_host 3.22s call test_tmp_policy/test.py::test_disk_selection 2.39s call test_storage_s3/test.py::test_select_columns 2.37s call test_storage_s3/test.py::test_s3_schema_inference 2.05s teardown test_system_logs_comment/test.py::test_system_logs_comment 1.99s teardown test_temporary_data/test.py::test_tmp_data_no_leftovers 1.81s call test_storage_s3/test.py::test_seekable_formats 1.64s call test_ttl_move/test.py::test_replicated_download_ttl_info 1.62s call test_storage_s3/test.py::test_multipart[positive] 1.56s call test_storage_s3/test.py::test_seekable_formats_url 1.40s call test_ttl_move/test.py::test_moves_to_disk_eventually_work[mt_test_moves_to_disk_eventually_work] 1.14s call test_storage_s3/test.py::test_skip_empty_files 1.03s call test_ttl_move/test.py::test_rule_with_invalid_destination[case3] 1.01s call test_ttl_move/test.py::test_moves_to_disk_eventually_work[replicated_mt_test_moves_to_disk_eventually_work] 0.75s call test_storage_s3/test.py::test_predefined_connection_configuration 0.72s call test_ttl_move/test.py::test_rule_with_invalid_destination[case2] 0.72s call test_storage_s3/test.py::test_schema_inference_from_globs 0.70s call test_storage_s3/test.py::test_read_subcolumns 0.52s call test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_do_not_work] 0.50s call test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_do_not_work] 0.49s call test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_work] 0.49s call test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_work] 0.49s call test_storage_s3/test.py::test_signatures 0.48s call test_storage_s3/test.py::test_wrong_format_usage 0.38s call test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_do_not_work] 0.38s call test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_work_1] 0.36s call test_storage_s3/test.py::test_overwrite 0.31s call test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_do_not_work] 0.31s call test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_work_1] 0.30s call test_storage_s3/test.py::test_truncate_table 0.26s call test_ttl_move/test.py::test_rule_with_invalid_destination[case1] 0.26s call test_ttl_move/test.py::test_rule_with_invalid_destination[case0] 0.20s call test_storage_s3/test.py::test_storage_s3_get_gzip[bin] 0.20s call test_storage_s3/test.py::test_storage_s3_put_gzip[bin] 0.20s call test_storage_s3/test.py::test_storage_s3_put_gzip[gz] 0.18s call test_storage_s3/test.py::test_partition_by 0.17s call test_storage_s3/test.py::test_storage_s3_get_gzip[gz] 0.17s call test_storage_s3/test.py::test_storage_s3_put_uncompressed 0.13s call test_storage_s3/test.py::test_put_get_with_redirect 0.10s call test_storage_s3/test.py::test_remote_host_filter 0.07s call test_storage_s3/test.py::test_partition_by_string_column 0.07s call test_storage_s3/test.py::test_partition_by_const_column 0.07s call test_storage_s3/test.py::test_put_csv[auth_positive] 0.07s call test_storage_s3/test.py::test_put[positive] 0.07s call test_storage_s3/test.py::test_put[auth_positive] 0.07s call test_storage_s3/test.py::test_put_csv[positive] 0.07s call test_storage_s3/test.py::test_wrong_s3_syntax 0.07s call test_storage_s3/test.py::test_put_csv[negative] 0.07s call test_storage_s3/test.py::test_put[auto] 0.07s call test_storage_s3/test.py::test_put[zstd] 0.07s call test_storage_s3/test.py::test_put[xz] 0.07s call test_storage_s3/test.py::test_put[gzip] 0.07s call test_storage_s3/test.py::test_put[deflate] 0.07s call test_storage_s3/test.py::test_put[brotli] 0.00s call test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_with_interserver_listen_host 0.00s call test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_without_interserver_listen_host 0.00s teardown test_storage_s3/test.py::test_s3_glob_scheherazade 0.00s teardown test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[replicated_mt] 0.00s setup test_ttl_move/test.py::test_disabled_ttl_move_on_insert[disk] 0.00s teardown test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[mt] 0.00s setup test_ttl_move/test.py::test_alter_with_merge_work[replicated_work] 0.00s teardown test_ttl_move/test.py::test_alter_with_merge_work[mt_work] 0.00s teardown test_system_start_stop_listen/test.py::test_all_protocols 0.00s setup test_ttl_move/test.py::test_alter_with_merge_work[mt_work] 0.00s setup test_ttl_move/test.py::test_materialize_ttl_in_partition[replicated] 0.00s teardown test_ttl_move/test.py::test_alter_multiple_ttls[negative] 0.00s setup test_ttl_move/test.py::test_moves_work_after_storage_policy_change[replicated_mt_test_moves_work_after_storage_policy_change] 0.00s setup test_ttl_move/test.py::test_moves_to_disk_eventually_work[mt_test_moves_to_disk_eventually_work] 0.00s setup test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_work] 0.00s setup test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_work_1] 0.00s setup test_storage_s3/test.py::test_partition_by 0.00s setup test_ttl_move/test.py::test_merges_to_disk_work[replicated_mt_test_merges_to_disk_work] 0.00s setup test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_work_1] 0.00s setup test_ttl_move/test.py::test_alter_multiple_ttls[positive] 0.00s setup test_storage_s3/test.py::test_put_csv[auth_positive] 0.00s setup test_storage_s3/test.py::test_put_with_zero_redirect 0.00s setup test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_do_not_work] 0.00s teardown test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_do_not_work] 0.00s setup test_ttl_move/test.py::test_materialize_ttl_in_partition[mt] 0.00s setup test_ttl_move/test.py::test_rule_with_invalid_destination[case2] 0.00s setup test_storage_s3/test.py::test_put[auto] 0.00s setup test_ttl_move/test.py::test_rule_with_invalid_destination[case3] 0.00s setup test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_do_not_work] 0.00s setup test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_disk] 0.00s setup test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_do_not_work] 0.00s setup test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_do_not_work] 0.00s setup test_ttl_move/test.py::test_alter_with_merge_work[replicated] 0.00s setup test_ttl_move/test.py::test_rule_with_invalid_destination[case1] 0.00s setup test_storage_s3/test.py::test_storage_s3_get_gzip[gz] 0.00s setup test_ttl_move/test.py::test_rule_with_invalid_destination[case0] 0.00s teardown test_storage_s3/test.py::test_multipart[positive] 0.00s teardown test_ttl_move/test.py::test_alter_with_merge_work[replicated] 0.00s setup test_ttl_move/test.py::test_disabled_ttl_move_on_insert[volume] 0.00s setup test_ttl_move/test.py::test_moves_to_volume_work[mt_test_moves_to_volume_work] 0.00s setup test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_work] 0.00s setup test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_work] 0.00s teardown test_ttl_move/test.py::test_moves_to_volume_work[replicated_mt_test_moves_to_volume_work] 0.00s setup test_storage_s3/test.py::test_put_csv[positive] 0.00s setup test_storage_s3/test.py::test_put[auth_positive] 0.00s setup test_storage_s3/test.py::test_schema_inference_cache 0.00s setup test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_do_not_work] 0.00s teardown test_storage_s3/test.py::test_parallel_reading_with_memory_limit 0.00s setup test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_do_not_work] 0.00s setup test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_do_not_work] 0.00s teardown test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_work] 0.00s setup test_ttl_move/test.py::test_moves_work_after_storage_policy_change[mt_test_moves_work_after_storage_policy_change] 0.00s setup test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[replicated_mt] 0.00s teardown test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_do_not_work] 0.00s setup test_storage_s3/test.py::test_partition_by_const_column 0.00s setup test_storage_s3/test.py::test_storage_s3_put_gzip[gz] 0.00s setup test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_work] 0.00s setup test_ttl_move/test.py::test_moves_to_disk_eventually_work[replicated_mt_test_moves_to_disk_eventually_work] 0.00s teardown test_ttl_move/test.py::test_moves_to_disk_eventually_work[mt_test_moves_to_disk_eventually_work] 0.00s setup test_storage_s3/test.py::test_put[zstd] 0.00s teardown test_ttl_move/test.py::test_moves_work_after_storage_policy_change[mt_test_moves_work_after_storage_policy_change] 0.00s setup test_storage_s3/test.py::test_schema_inference_from_globs 0.00s setup test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_work] 0.00s setup test_storage_s3/test.py::test_put_csv[negative] 0.00s setup test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[mt] 0.00s setup test_ttl_move/test.py::test_alter_with_merge_work[mt] 0.00s setup test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work0] 0.00s setup test_storage_s3/test.py::test_storage_s3_get_gzip[bin] 0.00s setup test_storage_s3/test.py::test_s3_schema_inference 0.00s setup test_ttl_move/test.py::test_merges_with_full_disk_work[mt_test_merges_with_full_disk_work] 0.00s teardown test_storage_s3/test.py::test_schema_inference_cache 0.00s teardown test_storage_s3/test.py::test_s3_list_objects_failure 0.00s teardown test_storage_s3/test.py::test_put_get_with_globs 0.00s setup test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_do_not_work] 0.00s setup test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_work] 0.00s teardown test_ttl_move/test.py::test_alter_with_merge_work[replicated_work] 0.00s setup test_storage_s3/test.py::test_partition_by_string_column 0.00s setup test_ttl_move/test.py::test_moves_to_volume_work[replicated_mt_test_moves_to_volume_work] 0.00s setup test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work1] 0.00s teardown test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_do_not_work] 0.00s setup test_ttl_move/test.py::test_merges_with_full_disk_work[replicated_mt_test_merges_with_full_disk_work] 0.00s teardown test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_do_not_work] 0.00s teardown test_ttl_move/test.py::test_materialize_ttl_in_partition[mt] 0.00s setup test_ttl_move/test.py::test_alter_multiple_ttls[replicated_positive] 0.00s setup test_storage_s3/test.py::test_storage_s3_put_gzip[bin] 0.00s teardown test_system_start_stop_listen/test.py::test_default_protocols 0.00s setup test_storage_s3/test.py::test_seekable_formats 0.00s teardown test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_work] 0.00s teardown test_ttl_move/test.py::test_disabled_ttl_move_on_insert[disk] 0.00s setup test_ttl_move/test.py::test_alter_multiple_ttls[replicated_negative] 0.00s teardown test_storage_s3/test.py::test_select_columns 0.00s setup test_storage_s3/test.py::test_put[xz] 0.00s teardown test_storage_s3/test.py::test_storage_s3_get_gzip[gz] 0.00s setup test_storage_s3/test.py::test_truncate_table 0.00s teardown test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_do_not_work] 0.00s teardown test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_work_1] 0.00s setup test_storage_s3/test.py::test_select_columns 0.00s teardown test_ttl_move/test.py::test_alter_with_merge_work[mt] 0.00s setup test_storage_s3/test.py::test_put[positive] 0.00s setup test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_volume] 0.00s setup test_storage_s3/test.py::test_put[gzip] 0.00s teardown test_storage_s3/test.py::test_s3_schema_inference 0.00s teardown test_storage_s3/test.py::test_put[zstd] 0.00s teardown test_storage_s3/test.py::test_partition_by 0.00s setup test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_work] 0.00s setup test_storage_s3/test.py::test_s3_glob_scheherazade 0.00s teardown test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_work] 0.00s teardown test_storage_s3/test.py::test_put[auth_positive] 0.00s setup test_system_start_stop_listen/test.py::test_custom_protocols 0.00s setup test_storage_s3/test.py::test_put[deflate] 0.00s teardown test_ttl_move/test.py::test_rule_with_invalid_destination[case2] 0.00s setup test_storage_s3/test.py::test_put[brotli] 0.00s teardown test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_work] 0.00s teardown test_ttl_move/test.py::test_alter_multiple_ttls[replicated_negative] 0.00s teardown test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_do_not_work] 0.00s teardown test_storage_s3/test.py::test_put_csv[auth_positive] 0.00s teardown test_storage_s3/test.py::test_storage_s3_put_gzip[bin] 0.00s teardown test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_work] 0.00s teardown test_storage_s3/test.py::test_put_csv[negative] 0.00s setup test_storage_s3/test.py::test_wrong_s3_syntax 0.00s teardown test_ttl_move/test.py::test_materialize_ttl_in_partition[replicated] 0.00s setup test_storage_s3/test.py::test_signatures 0.00s teardown test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_disk] 0.00s setup test_storage_s3/test.py::test_storage_s3_get_unstable 0.00s teardown test_storage_s3/test.py::test_storage_s3_get_gzip[bin] 0.00s setup test_storage_s3/test.py::test_wrong_format_usage 0.00s teardown test_storage_s3/test.py::test_overwrite 0.00s teardown test_system_start_stop_listen/test.py::test_custom_protocols 0.00s teardown test_ttl_move/test.py::test_merges_with_full_disk_work[replicated_mt_test_merges_with_full_disk_work] 0.00s teardown test_storage_s3/test.py::test_seekable_formats_url 0.00s teardown test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_work] 0.00s teardown test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_work] 0.00s teardown test_ttl_move/test.py::test_rule_with_invalid_destination[case0] 0.00s teardown test_ttl_move/test.py::test_moves_to_volume_work[mt_test_moves_to_volume_work] 0.00s teardown test_storage_s3/test.py::test_partition_by_const_column 0.00s teardown test_storage_s3/test.py::test_schema_inference_from_globs 0.00s setup test_system_start_stop_listen/test.py::test_default_protocols 0.00s setup test_storage_s3/test.py::test_storage_s3_put_uncompressed 0.00s setup test_storage_s3/test.py::test_overwrite 0.00s teardown test_storage_s3/test.py::test_wrong_format_usage 0.00s setup test_system_start_stop_listen/test.py::test_except 0.00s teardown test_ttl_move/test.py::test_alter_multiple_ttls[replicated_positive] 0.00s teardown test_storage_s3/test.py::test_storage_s3_put_gzip[gz] 0.00s teardown test_ttl_move/test.py::test_moves_work_after_storage_policy_change[replicated_mt_test_moves_work_after_storage_policy_change] 0.00s teardown test_ttl_move/test.py::test_rule_with_invalid_destination[case1] 0.00s setup test_storage_s3/test.py::test_seekable_formats_url 0.00s setup test_storage_s3/test.py::test_put_get_with_redirect 0.00s teardown test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_volume] 0.00s teardown test_ttl_move/test.py::test_merges_to_disk_work[replicated_mt_test_merges_to_disk_work] 0.00s teardown test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_work_1] 0.00s teardown test_storage_s3/test.py::test_truncate_table 0.00s teardown test_storage_s3/test.py::test_seekable_formats 0.00s teardown test_storage_s3/test.py::test_storage_s3_put_uncompressed 0.00s teardown test_storage_s3/test.py::test_remote_host_filter 0.00s teardown test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_with_interserver_listen_host 0.00s setup test_storage_s3/test.py::test_remote_host_filter 0.00s teardown test_storage_s3/test.py::test_signatures 0.00s setup test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_without_interserver_listen_host 0.00s setup test_storage_s3/test.py::test_read_subcolumns 0.00s setup test_storage_s3/test.py::test_predefined_connection_configuration 0.00s setup test_storage_s3/test.py::test_parallel_reading_with_memory_limit 0.00s teardown test_storage_s3/test.py::test_put_csv[positive] 0.00s setup test_ttl_move/test.py::test_replicated_download_ttl_info 0.00s setup test_storage_s3/test.py::test_put_get_with_globs 0.00s setup test_storage_s3/test.py::test_s3_list_objects_failure 0.00s teardown test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work0] 0.00s teardown test_ttl_move/test.py::test_alter_multiple_ttls[positive] 0.00s teardown test_storage_s3/test.py::test_skip_empty_files 0.00s setup test_storage_s3/test.py::test_skip_empty_files 0.00s teardown test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work1] 0.00s teardown test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_do_not_work] 0.00s teardown test_ttl_move/test.py::test_disabled_ttl_move_on_insert[volume] 0.00s teardown test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_do_not_work] 0.00s teardown test_ttl_move/test.py::test_merges_with_full_disk_work[mt_test_merges_with_full_disk_work] 0.00s teardown test_ttl_move/test.py::test_moves_to_disk_eventually_work[replicated_mt_test_moves_to_disk_eventually_work] 0.00s teardown test_storage_s3/test.py::test_read_subcolumns 0.00s teardown test_storage_s3/test.py::test_put[xz] 0.00s teardown test_storage_s3/test.py::test_predefined_connection_configuration 0.00s teardown test_storage_s3/test.py::test_put_with_zero_redirect 0.00s teardown test_ttl_move/test.py::test_replicated_download_ttl_info 0.00s teardown test_storage_s3/test.py::test_partition_by_string_column 0.00s teardown test_storage_s3/test.py::test_put[deflate] 0.00s teardown test_storage_s3/test.py::test_put[positive] 0.00s teardown test_storage_s3/test.py::test_put_get_with_redirect 0.00s teardown test_storage_s3/test.py::test_put[gzip] 0.00s teardown test_storage_s3/test.py::test_put[auto] 0.00s teardown test_storage_s3/test.py::test_put[brotli] 0.00s teardown test_storage_s3/test.py::test_storage_s3_get_unstable =========================== short test summary info ============================ FAILED test_system_start_stop_listen/test.py::test_all_protocols - helpers.cl... FAILED test_system_start_stop_listen/test.py::test_custom_protocols - helpers... FAILED test_system_start_stop_listen/test.py::test_default_protocols - helper... FAILED test_system_start_stop_listen/test.py::test_except - helpers.client.Qu... PASSED test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_with_interserver_listen_host PASSED test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_without_interserver_listen_host PASSED test_tmp_policy/test.py::test_disk_selection PASSED test_system_logs_comment/test.py::test_system_logs_comment PASSED test_temporary_data/test.py::test_tmp_data_no_leftovers PASSED test_ttl_move/test.py::test_alter_multiple_ttls[negative] PASSED test_ttl_move/test.py::test_alter_multiple_ttls[positive] PASSED test_storage_s3/test.py::test_multipart[positive] PASSED test_storage_s3/test.py::test_overwrite PASSED test_ttl_move/test.py::test_alter_multiple_ttls[replicated_negative] PASSED test_storage_s3/test.py::test_parallel_reading_with_memory_limit PASSED test_storage_s3/test.py::test_partition_by PASSED test_storage_s3/test.py::test_partition_by_const_column PASSED test_storage_s3/test.py::test_partition_by_string_column PASSED test_storage_s3/test.py::test_predefined_connection_configuration PASSED test_storage_s3/test.py::test_put[auth_positive] PASSED test_storage_s3/test.py::test_put[auto] PASSED test_storage_s3/test.py::test_put[brotli] PASSED test_storage_s3/test.py::test_put[deflate] PASSED test_storage_s3/test.py::test_put[gzip] PASSED test_storage_s3/test.py::test_put[positive] PASSED test_storage_s3/test.py::test_put[xz] PASSED test_storage_s3/test.py::test_put[zstd] PASSED test_storage_s3/test.py::test_put_csv[auth_positive] PASSED test_storage_s3/test.py::test_put_csv[negative] PASSED test_storage_s3/test.py::test_put_csv[positive] PASSED test_storage_s3/test.py::test_put_get_with_globs PASSED test_storage_s3/test.py::test_put_get_with_redirect PASSED test_ttl_move/test.py::test_alter_multiple_ttls[replicated_positive] PASSED test_ttl_move/test.py::test_alter_with_merge_work[mt] PASSED test_storage_s3/test.py::test_put_with_zero_redirect PASSED test_storage_s3/test.py::test_read_subcolumns PASSED test_storage_s3/test.py::test_remote_host_filter PASSED test_ttl_move/test.py::test_alter_with_merge_work[mt_work] PASSED test_storage_s3/test.py::test_s3_glob_scheherazade PASSED test_ttl_move/test.py::test_alter_with_merge_work[replicated] PASSED test_storage_s3/test.py::test_s3_list_objects_failure PASSED test_storage_s3/test.py::test_s3_schema_inference PASSED test_ttl_move/test.py::test_alter_with_merge_work[replicated_work] PASSED test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[mt] PASSED test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[replicated_mt] PASSED test_ttl_move/test.py::test_disabled_ttl_move_on_insert[disk] PASSED test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_disk] PASSED test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_volume] PASSED test_storage_s3/test.py::test_schema_inference_cache PASSED test_storage_s3/test.py::test_schema_inference_from_globs PASSED test_ttl_move/test.py::test_disabled_ttl_move_on_insert[volume] PASSED test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_do_not_work] PASSED test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_work_1] PASSED test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_do_not_work] PASSED test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_work_1] PASSED test_storage_s3/test.py::test_seekable_formats PASSED test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_do_not_work] PASSED test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_work] PASSED test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_do_not_work] PASSED test_storage_s3/test.py::test_seekable_formats_url PASSED test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_work] PASSED test_storage_s3/test.py::test_select_columns PASSED test_storage_s3/test.py::test_signatures PASSED test_storage_s3/test.py::test_skip_empty_files PASSED test_storage_s3/test.py::test_storage_s3_get_gzip[bin] PASSED test_storage_s3/test.py::test_storage_s3_get_gzip[gz] PASSED test_ttl_move/test.py::test_materialize_ttl_in_partition[mt] PASSED test_storage_s3/test.py::test_storage_s3_get_unstable PASSED test_storage_s3/test.py::test_storage_s3_put_gzip[bin] PASSED test_storage_s3/test.py::test_storage_s3_put_gzip[gz] PASSED test_storage_s3/test.py::test_storage_s3_put_uncompressed PASSED test_storage_s3/test.py::test_truncate_table PASSED test_storage_s3/test.py::test_wrong_format_usage PASSED test_storage_s3/test.py::test_wrong_s3_syntax PASSED test_ttl_move/test.py::test_materialize_ttl_in_partition[replicated] PASSED test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work0] PASSED test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work1] PASSED test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_work] PASSED test_ttl_move/test.py::test_merges_to_disk_work[replicated_mt_test_merges_to_disk_work] PASSED test_ttl_move/test.py::test_merges_with_full_disk_work[mt_test_merges_with_full_disk_work] PASSED test_ttl_move/test.py::test_merges_with_full_disk_work[replicated_mt_test_merges_with_full_disk_work] PASSED test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_do_not_work] PASSED test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_work] PASSED test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_do_not_work] PASSED test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_work] PASSED test_ttl_move/test.py::test_moves_to_disk_eventually_work[mt_test_moves_to_disk_eventually_work] PASSED test_ttl_move/test.py::test_moves_to_disk_eventually_work[replicated_mt_test_moves_to_disk_eventually_work] PASSED test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_do_not_work] PASSED test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_work] PASSED test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_do_not_work] PASSED test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_work] PASSED test_ttl_move/test.py::test_moves_to_volume_work[mt_test_moves_to_volume_work] PASSED test_ttl_move/test.py::test_moves_to_volume_work[replicated_mt_test_moves_to_volume_work] PASSED test_ttl_move/test.py::test_moves_work_after_storage_policy_change[mt_test_moves_work_after_storage_policy_change] PASSED test_ttl_move/test.py::test_moves_work_after_storage_policy_change[replicated_mt_test_moves_work_after_storage_policy_change] PASSED test_ttl_move/test.py::test_replicated_download_ttl_info PASSED test_ttl_move/test.py::test_rule_with_invalid_destination[case0] PASSED test_ttl_move/test.py::test_rule_with_invalid_destination[case1] PASSED test_ttl_move/test.py::test_rule_with_invalid_destination[case2] PASSED test_ttl_move/test.py::test_rule_with_invalid_destination[case3] =================== 4 failed, 96 passed in 567.95s (0:09:27) =================== Traceback (most recent call last): File "/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration/./runner", line 455, in subprocess.check_call(cmd, shell=True) File "/usr/lib/python3.10/subprocess.py", line 369, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command 'docker run --rm --name clickhouse_integration_tests_fp1ps5 --privileged --dns-search='.' --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/_temp/test/git-repo-copy/src/Server/grpc_protos:/ClickHouse/src/Server/grpc_protos --volume=/run:/run/host:ro --mount type=bind,source=/home/ubuntu/_work/_temp/test/dockerd_volume_dir,target=/var/lib/docker -e DOCKER_HELPER_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_BASE_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_KERBERIZED_HADOOP_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_KERBEROS_KDC_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_MYSQL_JAVA_CLIENT_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_MYSQL_JS_CLIENT_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_MYSQL_PHP_CLIENT_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_NGINX_DAV_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=0-b53fc9f68f30219552c427c7d7d451342728b9a4 -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 'test_storage_s3/test.py::test_multipart[positive]' test_storage_s3/test.py::test_overwrite test_storage_s3/test.py::test_parallel_reading_with_memory_limit test_storage_s3/test.py::test_partition_by test_storage_s3/test.py::test_partition_by_const_column test_storage_s3/test.py::test_partition_by_string_column test_storage_s3/test.py::test_predefined_connection_configuration 'test_storage_s3/test.py::test_put[auth_positive]' 'test_storage_s3/test.py::test_put[auto]' 'test_storage_s3/test.py::test_put[brotli]' 'test_storage_s3/test.py::test_put[deflate]' 'test_storage_s3/test.py::test_put[gzip]' 'test_storage_s3/test.py::test_put[positive]' 'test_storage_s3/test.py::test_put[xz]' 'test_storage_s3/test.py::test_put[zstd]' 'test_storage_s3/test.py::test_put_csv[auth_positive]' 'test_storage_s3/test.py::test_put_csv[negative]' 'test_storage_s3/test.py::test_put_csv[positive]' test_storage_s3/test.py::test_put_get_with_globs test_storage_s3/test.py::test_put_get_with_redirect test_storage_s3/test.py::test_put_with_zero_redirect test_storage_s3/test.py::test_read_subcolumns test_storage_s3/test.py::test_remote_host_filter test_storage_s3/test.py::test_s3_glob_scheherazade test_storage_s3/test.py::test_s3_list_objects_failure test_storage_s3/test.py::test_s3_schema_inference test_storage_s3/test.py::test_schema_inference_cache test_storage_s3/test.py::test_schema_inference_from_globs test_storage_s3/test.py::test_seekable_formats test_storage_s3/test.py::test_seekable_formats_url test_storage_s3/test.py::test_select_columns test_storage_s3/test.py::test_signatures test_storage_s3/test.py::test_skip_empty_files 'test_storage_s3/test.py::test_storage_s3_get_gzip[bin]' 'test_storage_s3/test.py::test_storage_s3_get_gzip[gz]' test_storage_s3/test.py::test_storage_s3_get_unstable 'test_storage_s3/test.py::test_storage_s3_put_gzip[bin]' 'test_storage_s3/test.py::test_storage_s3_put_gzip[gz]' test_storage_s3/test.py::test_storage_s3_put_uncompressed test_storage_s3/test.py::test_truncate_table test_storage_s3/test.py::test_wrong_format_usage test_storage_s3/test.py::test_wrong_s3_syntax test_system_logs_comment/test.py::test_system_logs_comment test_system_start_stop_listen/test.py::test_all_protocols test_system_start_stop_listen/test.py::test_custom_protocols test_system_start_stop_listen/test.py::test_default_protocols test_system_start_stop_listen/test.py::test_except test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_with_interserver_listen_host test_tcp_handler_interserver_listen_host/test_case.py::test_request_to_node_without_interserver_listen_host test_temporary_data/test.py::test_tmp_data_no_leftovers test_tmp_policy/test.py::test_disk_selection 'test_ttl_move/test.py::test_alter_multiple_ttls[negative]' 'test_ttl_move/test.py::test_alter_multiple_ttls[positive]' 'test_ttl_move/test.py::test_alter_multiple_ttls[replicated_negative]' 'test_ttl_move/test.py::test_alter_multiple_ttls[replicated_positive]' 'test_ttl_move/test.py::test_alter_with_merge_work[mt]' 'test_ttl_move/test.py::test_alter_with_merge_work[mt_work]' 'test_ttl_move/test.py::test_alter_with_merge_work[replicated]' 'test_ttl_move/test.py::test_alter_with_merge_work[replicated_work]' 'test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[mt]' 'test_ttl_move/test.py::test_concurrent_alter_with_ttl_move[replicated_mt]' 'test_ttl_move/test.py::test_disabled_ttl_move_on_insert[disk]' 'test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_disk]' 'test_ttl_move/test.py::test_disabled_ttl_move_on_insert[replicated_volume]' 'test_ttl_move/test.py::test_disabled_ttl_move_on_insert[volume]' 'test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_do_not_work]' 'test_ttl_move/test.py::test_inserts_to_disk_work[mt_test_inserts_to_disk_work_1]' 'test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_do_not_work]' 'test_ttl_move/test.py::test_inserts_to_disk_work[replicated_mt_test_inserts_to_disk_work_1]' 'test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_do_not_work]' 'test_ttl_move/test.py::test_inserts_to_volume_work[mt_test_inserts_to_volume_work]' 'test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_do_not_work]' 'test_ttl_move/test.py::test_inserts_to_volume_work[replicated_mt_test_inserts_to_volume_work]' 'test_ttl_move/test.py::test_materialize_ttl_in_partition[mt]' 'test_ttl_move/test.py::test_materialize_ttl_in_partition[replicated]' 'test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work0]' 'test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_do_not_work1]' 'test_ttl_move/test.py::test_merges_to_disk_work[mt_test_merges_to_disk_work]' 'test_ttl_move/test.py::test_merges_to_disk_work[replicated_mt_test_merges_to_disk_work]' 'test_ttl_move/test.py::test_merges_with_full_disk_work[mt_test_merges_with_full_disk_work]' 'test_ttl_move/test.py::test_merges_with_full_disk_work[replicated_mt_test_merges_with_full_disk_work]' 'test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_do_not_work]' 'test_ttl_move/test.py::test_moves_after_merges_work[mt_test_moves_after_merges_work]' 'test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_do_not_work]' 'test_ttl_move/test.py::test_moves_after_merges_work[replicated_mt_test_moves_after_merges_work]' 'test_ttl_move/test.py::test_moves_to_disk_eventually_work[mt_test_moves_to_disk_eventually_work]' 'test_ttl_move/test.py::test_moves_to_disk_eventually_work[replicated_mt_test_moves_to_disk_eventually_work]' 'test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_do_not_work]' 'test_ttl_move/test.py::test_moves_to_disk_work[mt_test_moves_to_disk_work]' 'test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_do_not_work]' 'test_ttl_move/test.py::test_moves_to_disk_work[replicated_mt_test_moves_to_disk_work]' 'test_ttl_move/test.py::test_moves_to_volume_work[mt_test_moves_to_volume_work]' 'test_ttl_move/test.py::test_moves_to_volume_work[replicated_mt_test_moves_to_volume_work]' 'test_ttl_move/test.py::test_moves_work_after_storage_policy_change[mt_test_moves_work_after_storage_policy_change]' 'test_ttl_move/test.py::test_moves_work_after_storage_policy_change[replicated_mt_test_moves_work_after_storage_policy_change]' test_ttl_move/test.py::test_replicated_download_ttl_info 'test_ttl_move/test.py::test_rule_with_invalid_destination[case0]' 'test_ttl_move/test.py::test_rule_with_invalid_destination[case1]' 'test_ttl_move/test.py::test_rule_with_invalid_destination[case2]' 'test_ttl_move/test.py::test_rule_with_invalid_destination[case3]' -vvv" altinityinfra/integration-tests-runner:0-b53fc9f68f30219552c427c7d7d451342728b9a4 ' returned non-zero exit status 1.